L-  72-op  I  \/ 


state  of  Montana 
Office  of  the  Legislative  Auditor 


Performance  Audit 

OFFICE  OF  PUBLIC  INSTRUCTION 

Department  of  Vocational 

Education  Services 


PLEASE  RETURN 


This  report  contains  recommendations  concerning  the 
department's  role  and  activities  regarding  vocational 
education.  These  recommendations  include: 


Improving  vocational  educational  planning  at  the 
secondary  school/vo-tech  center  levels. 

Conducting  periodic  regional  vocational  education 
and  occupational  needs  assessments. 

Developing  a  centralized  student/employer  follow- 
up  system. 

Implementing  a  formal  vocational  education  cur- 
riculum development  and  review  process. 

Requiring  adequate  job  placement  and  job  devel- 
opment at  the  vo-tech  centers. 

Coordinating  department  evaluation  activities. 


S^ftTE  DOCUMENTS  COLLECTlOfl 

ftpR  1  B  IQ'-^^ 

MONTANA  STATE  LIBRARY 

1515  E.  6th  AVE. 
HELENA,  MONTANA  59620 


Office  of  the  Legislative  Auditor 
Room  135,  State  Capitol 
Helena,  Montana  59620 


84P-10 


MAY  2  8  «Qe  MONTANA  STATE  LIBRARY 

"""'  S  351 .7232  L72opiv  1 984  c.  1 

_,_._,  Performance  audit.  Office  of  Public  Inst 

OV 171988  lillllilllllllllllllllill 

3  0864  00050554  8 


W' 


?v 


-'i'^f 


$C- 


ROBERT  R.  RINGWOOD 

LEGISLATIVE  AUDITOR 


STATE  OF  MONTANA 


Mtitt  ixt  tlt^  'ft^hhix'txt:  ^nhiinx 


STATE  CAPITOL 

HELENA,  MONTANA  59620 

406/444-3122 


December   1984 


DEPUTY  LEGISLATIVE  AUDITORS: 

JAMES  H.  GILLETT 
FINANCIAUCOMPLIANCE  AUDITS 

SCOTT  A.  SEACAT 
PERFORMANCE  AUDITS 

STAFF  LEGAL  COUNSEL 

JOHN  W.  NORTHEY 


The   Legislative  Audit  Committee 
of  the  Montana   Legislature: 

This  is  our  performance  audit  of  the  Department  of  Vocational 
Education  Services  of  the  Office  of  Public  Instruction  (OPI)  and 
vocational  education  programs  and  activities  provided  by  the 
secondary  schools  and  the  postsecondary  vocational-technical 
centers. 

This  report  contains  recommendations  concerning  department  and 
OPI  activities.  The  OPI  response  is  contained  in  this  report 
beginning   on   page  'l9. 

We  wish  to  express  our  appreciation  to  the  staffs  of  the  depart- 
ment and  OPI    for  their  cooperation  and  assistance. 


RosQectfully   sub 


Scott  A.   Seacat 

Deputy   Legislative  Auditor 


Approved 


:0 


^■^S-C^ 


Robert   R.    Rir^qwood 
Legislative  AUflitor 


C) 


TABLE   OF  CONTENTS 

Page 

List  of  Illustrations  iv 

Administrative  Officials  v 

Summary  of  Recommendations  vl 

Chapter     I 
Introduction 

Objectives  of  Audit  1 

Scope  of  Audit  1 

Compliance  2 

Preliminary  Survey   Concerns  2 

Chapter   II 
Background 

Department  Organization  and  Staffing  5 

Department  Expenditures  6 

Department   Responsibilities  7 

Vocational   Funding  8 

Chapter   III 
Secondary  Vocational   Education 

Secondary  N'ocational   Education   Programs  12 

State  Excess   Cost   Funding  13 

Departnont  Activity   Related  to  Secondary 

Vocational   Education  ^'^ 

Project  Applications  14 

Secondary  Vocational   Program  Evaluations  15 

Secondary  Vocational   Student  Follow-up  Information                       16 

Student  Organizations  16 

Technical  Assistance  16 


TABLE  OF  CONTENTS    (Continued) 

Page 

Chapter   IV 
Postsecondary   Vocational   Education 

At   Vocational-Technical   Centers 

Governance  of  the  Vo-Tech   Centers  17 

Vo-Tech   Center  Expenditures  18 

House  Joint   Resolution   46  18 

Postsecondary  Vocational   Education   Programs  19 

Department  Activity   Related   to  Postsecondary 

Vocational   Education  19 

Policies  and   Procedures  Manual  20 

Postsecondary  Vo-Tech   Center  Evaluations  20 

Follow-up  Data  on   Former  Vo-Tech   Center 

Students  20 

Technical  Assistance  21 

Apprenticeship  Training  21 

Chapter  V 
School/Center  Operations 

and   Related   Department  Activity 

School/Center  Vocational   Education   Planning  Activity  22 

Needs  Assessments  24 

Student/Employer   Follow-up  25 

Advisory  Councils/Program  Advisory  Committees  27 

Vocational   Education   Curriculum  Development  28 

Vocational   Teacher  Development  30 

Teacher  Certification  32 

Job   Placement/Job   Development  Activities  33 

Equipment  36 


TABLE  OF  CONTENTS   (Continued) 


Chapter  VI 
Department  Management  of  Vocational   Education 


Page 


rianagement    Information  38 

Department  On-Site  Evaluation   Process  39 

Evaluation   Coverage  40 

Evaluation   Duplication  41 

Follow-up  of  Department  Evaluation   Recommendations  42 

Department  Enforcement  Activity  44 


Chapter  VII 
Summary  46 


LIST  OF   ILLUSTRATIONS 

No.  Page 

T  Organization   of  the  Department  of 

Vocational   Education  Services 

2  Department  Expenditures 

3  Total   Funding   for  Secondary  and 

Postsecondary  Vocational   Education 

4  Federal  Vocational   Education   Funds 

5  Secondary  Student  ANB    Enrollment   by   Program 

6  Department   Evaluation    Regions 

7  Vo-Tech   Center  Student   FTE  Enrollment 

8  Vo-Tech   Center  Expenditures  by  Source 

9  Percentage  of  1982-83   School/Center  Graduates 

Not   Employed  in  Area  of  Vocational  Training  35 

10  Department  of  Vocational   Education   Services 

On-Site  Vocational   Education   Program  Evaluations  tO 


6 

7 

8 

10 

12 

15 

17 

18 

ADMINISTRATIVE  OFFICIALS 


OFFICE   OF   PUBLIC    INSTRUCTION 


Ed  Argenbright,    Siiporintendent  of  Public   Instruction 
and  Executive  Officer  of  Vocational   Education 

Dr.    W.    Anderson,    Deputy  Superintendent 

Gary  Steuerwald,   Assistant  Superintendent 
Department  of  Administrative  Services 


DEPARTMENT   OF  VOCATIONAL   EDUCATION   SERVICES 


Gene  Christiaansen,   Assistant  Superintendent 
for  Vocational   Education   Services 

Jim  Whealon,    Executive  Assistant 


SUMMARY   OF   RECOMMENDATIONS 

The  following  is  a  listing  of  report  recommendations  together  with 
a  notation  as  to  whether  Office  of  Public  Instruction  (OPI)  officials 
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Recommendation   #1 


The  department: 

A.  Revise  the  present  format  for  secondary 
school  vocational  education   planning 

documents.  23 

OPI    Response:      Concur.      See  page  50. 

B.  Reguire  schools/centers  to  comply  with 
department  planning   document  formats 

and  deadlines.  24 

OPI    Response:      Concur.      See  page  50. 

Recommendation   #2 

The  department: 

A.  Conduct  periodic   regional   vocational 
education  and  occupational   needs 
assessments  within  Montana  and  make 
the  results  available  to  the  schools/ 

centers.  25 

OPI    Response:      Partially  concur.      See  page  50. 

B.  Establish   specific  criteria  and   format 

for  the  regional   needs  assessments.  25 

OPI    Response:      Concur.      See  page  50. 

C.  Provide  schools/centers  assistance  in 
the  use  of  the  regional   needs  assess- 
ments. 25 

OPI    Response:      Concur.      See  page  50. 

D.  Revise  administrative   rules  so  that 
schools/centers  are   not   required   to 

conduct  extensive  needs  assessments.  25 

OPI    Response:      Concur.      See  page  50. 
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SUMMARY  OF   RECOMMENDATIONS    (Continued) 

Page 
Recommendation   #3 

The  Office  of  Public   Instructions: 

A.  Develop  a  centralized  student/employer 
follow-up  system  that  will  meet  voca- 
tional and  accreditation    requirements.  27 

OPI    Response:      Concur.      See  page  51. 

B.  Provide  follow-up   results  to  the 

schools/centers,  27 

OPI    Response:      Concur.      See  page  51. 

C.  Revise  administrative  rules  and 
accreditation  standards  so  that 
schools/centers  are   not   required   to 

conduct   student/employer   follow-up.  27 

OPI    Response:      Will   take  under  advisement.      See  page  51. 

Recommendation   #4 

The  department: 

A.  Examine  the  role  and  current   require- 
ments  for  advisory  councils  and  pro- 
gram advisory  committees.  28 

OP!    Response:      Concur.      See  page  51. 

B.  Continue  to  provide  assistance  in 
cooperation   with  MACVE   to  increase 
advisory  council/committee  partici- 
pation. 28 

OPI    Response:      Concur.      See  page  51. 

Recommendation   #5 

The  department: 

A.       Reouire  a   formal   vocational  education 

curriculum  development  and   review   pro- 
cess be  implemented  by  schools/centers.  30 

OPI    Response:      Concur.      See  page  51. 
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B,  Specify  types  of  information   school/ 
center  officials   should  be  consider- 
ing  for  curriculum  development  and 

review.  30 

OPI    Response:      Concur.      See  page  52. 

C.  Obtain  and  consider  employer  input  as 
part  of  department  core  curriculum 

development  process.  30 

OPI    Response:      Partially   concur.      See  page  52. 

Recommendation   #6 

The  department: 

A.  Provide  additional    regional   training 
sessions  for  vocational  education 

teachers.  32 

OPI    Response:      Concur.      See  page  52. 

B.  Propose  to  the  Board  of  Public  Educa- 
tion  specific   requirements  that  voca- 
tional teachers  take  at   least  a  minimum 
number  of  trade-related  courses  over  a 

specified  time  period.  32 

OPI    Response:      Will   take  under  advisement.      See  page  52. 

Recommendation   #7 

The  department  develop  and  coordinate 

procedures  which   verify  certification 

of  vocational  education   teachers.  33 

OPI    Response:      Concur,      See  page  52. 

Recommendation   #8 

The  department: 

A.       Examine  the  need   for  job  placement  and 

job  development  at  the  secondary   school 

level  and   revise  administrative  rules 

accordingly.  36 


OPI    Response:      Concur.      See  page  53. 
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Page 

B.  Fnsure  that  vo-tech  centers  are  provid- 
ing  the  required   levels  of  job   placement 

and   job  development  services.  36 

OPI    Response:      Will   take  under  advisement.      See  page  53. 

C.  Coordinate  placement  activity   with   the 
state   Department  of  Labor  and    industry. 

Job  Services  Division.  36 

OPI    Response:      Concur.      See  page  53. 

Recommendation   #9 

The  department  establish   policies  and 

procedures  for  determining  equipment  needs 

and   replacement  of  out-of-date  equipment.  37 

OPI    Response:      Partially  concur.      See  page  53. 

Recommendation   #10 

The  department: 

A.  Assist  schools/centers  in  developing 

better  management  information   systems.  39 

OPI    Response:      Concur.      See  page  53. 

B.  Review  adequacy  of  present  department 
guidelines   in   the  management   informa- 
tion area   for  secondary   schools/vo- 

tech  centers.  39 

OPI    Response:      Concur.      See  page  53. 

C.  Improve  procedures  to  ensure  collection 

of  adequate  management  information.  39 

OPI    Response:      Concur.      See  page  54. 

Recommendation  #11 

The  department  develop  procedures  to  ensure 

that  all  approved  vocational   programs  are 

evaluated  within   the  five-year  time  frame.  41 

OPI    Response:      Concur.      See   page  54. 
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Recommendation   #12 

The  department  coordinate   its  evaluation 

activity   with  other  departments   within   OPI.  42 

OPI    Response:      Concur.      See  page  54. 

Recommendation   #13 

The  department: 

A.  Require  schools/centers  to  address 
department  evaluation   recommendations 

on   a  timely   basis.  43 

OPI    Response:      Concur.      See  page  54. 

B.  Visit  a   sample  of  schools  and  vo-tech 
centers  to  assess   school/center  efforts 
to  address  department  evaluation   recom- 
mendations. 44 

OPI    Response:      Partially  concur.      See  page  54. 

Recommendation  #14 

The  department  require  secondary  schools 
and  vo-tech  centers  to  comply  with  appli- 
cable vocational  education   requirements.  45 

OPI    Response:      Concur.      See  page  54. 


CHAPTER      I 

INTRODUCTION 

A  performance  audit  of  the  Department  of  Vocational  Education 
Services  of  the  Office  of  Public  Instruction  and  vocational  educa- 
tion programs  and  activities  provided  by  the  secondary  schools  and 
the  postsecondary  vocational-technical  (vo-tech)  centers  was 
performed  at  the  request  of  the  Legislative  Audit  Committee.  The 
audit  was  requested  after  preliminary  surveys  of  secondary  and 
postsecondary  vocational  education  were  presented  to  the  Committee 
in  Mav  1983  and  February  198^1,  respectively.  This  report  summa- 
rizes the   results  of  our  performance  audit. 

OBJECTIVES  OF  AUDIT 

The  objectives  of  this  performance  audit  were  to  determine  if 
vocational  education  programs  and  activities  supervised  by  the 
Office  of  Public  Instruction  are  being  managed  efficiently  and 
effectively,  and  to  identify  the  causes  of  any  inefficiencies  or 
ineffective  practices. 

During  our  audit  we  asked  officials  of  the  Office  of  Public 
Instruction  and  the  Department  of  Vocational  Education  Services 
for  responses  on  selected  audit  points.  These  areas  related  to 
report  issues  and  recommendations  and  were  discussed  with  depart- 
ment personnel  during   the  audit. 

A  management  memorandum  was  also  issued  during  our  audit. 
Through  this  memorandum  we  communicated  to  department  manage- 
ment issues  which  are  not  significant  enough  to  be  included  in  the 
audit  report,  but  were  such  that  department  officials  may  wish  to 
address  them. 

SCOPE  OF  AUDIT 

The  audit  focused  on  the  efficiency  and  effectiveness  of 
vocational  education  in  secondary  schools  and  vo-tech  centers  and 
Department  of  Vocational  Education  Services  management  of  these 
vocational  education  programs  and  activities.  It  did  not  include  a 
reviov/    of    the    financial    status    of    the    department    or    a    review    of 
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postsecondary  vocational  educational  programs  not  supervised  by 
the  Office  of  Public  Instruction.  The  audit  was  conducted  in 
accordance  with  generally  accepted  governmental  performance 
auditing   standards. 

During  our  audit,  we  visited  fourteen  secondary  schools  and 
the  five  vo-tech  centers  where  we  examined  and  observed  school/ 
vo-tech  center  vocational  policies,  procedures,  programs,  and 
available  records.  We  also  reviewed  department  operations. 
Interviews  were  conducted  with  department  staff,  school/center 
officials,  vocational  advisory  council/committee  members,  and 
employers  of  vocationally  trained  students. 

A  survey  questionnaire  was  sent  to  a  sample  of  school  year 
1982-83  school/center  graduates.  In  addition,  we  surveyed  a 
sample  of  current  students  during  our  visits.  The  questionnaires 
were  designed  to  provide  us  with  information  on  whether  school/ 
center  vocational  education  programs  and  activities  are  meeting 
student  needs.  Seven  regional  states  were  also  contacted  to  obtain 
comparative  information  on  the  organization  and  governance  of 
their  state's  vocational  education   system. 

COMPLIANCE 

As  part  of  our  audit  we  reviewed  compliance  with  laws, 
administrative  rules,  and  policies  related  to  secondary  school, 
vo-tech  center  and  department  vocational  education  programs  and 
activities.  Specific  instances  of  noncompliance  with  laws,  rules  or 
policies  that  were  found  during  our  review  are  discussed  in  the 
related  report  sections.  For  areas  not  included  in  our  audit 
scope,  and  therefore  not  specifically  tested  for  compliance,  nothing 
came  to  our  attention  during  our  audit  work  that  would  indicate 
the  schools/centers  or  the  department  are  not  adhering  to  estab- 
lished  laws,    rules,   and  policies. 

PRELIMINARY   SURVEY   CONCERNS 

In  1983  the  Office  of  the  Legislative  Auditor  conducted  a 
preliminary   survey   of  secondary   vocational   education   programs  and 


activities  administered  by  the  Department  of  Vocational  Education 
Services.  During  tbe  survey  three  concerns  were  identified  that 
were  either  being  addressed  or  corrected  at  the  time  of  our  audit 
work.      These  concerns  are  listeci   below. 


The  department  did  not  have  an  organized  information  filing 
system. 

Performance  evaluations  of  the  department  staff  had  not  been 
conducted. 

A  lack  of  communication/planning  regarding  vocational  educa- 
tion existed  between  officials  at  secondary  and  postsecondary 
institutions. 


During  our  audit  we  noted  that  the  department  had  estab- 
lished a  centralized  information  filing  system  and  the  department 
administrator  has  completed  staff  performance  evaluations.  Commu- 
nication/planning between  secondary  schools  and  vo-tech  centers  is 
also  improving. 

During  our  survey  of  secondary  vocational  education  we  noted 
that  the  method  of  funding  the  additional  or  excess  costs  of  secon- 
dary vocational  programs  had  not  been  recently  reviewed  by  OPI 
to  determine  its  reasonableness.  During  the  audit  we  did  not 
identify  any  concerns  regarding  the  current  method  of  funding  the 
excess  costs  of  secondary  vocational  education   programs. 

In  1984  the  Office  of  the  Legislative  Auditor  also  presented  to 
the  Legislative  Audit  Committee  a  preliminary  survey  of  post- 
secondary  vocational  education  programs  and  activities  supervised 
by  the  Department  of  Vocational  Education  Services.  During  the 
survey  two  administrative  concerns  were  identified  that  were  being 
addressed  at  the  time  of  audit  work.  These  concerns  are  listed 
below. 


1  .      Department    specialists    did    not    spend    adequate    time    on    post- 
secondary  vocational  education  activities. 

2.      The  department   had   no   system   of   follow-up   of  vo-tech   center 
annual   program   reviews. 


During  our  audit  work  we  noted  an  improvement  in  tine  amount 
of  time  department  specialists  spent  on  postsecondary  vocational 
education  programs  and  activities.  The  department  has  developed 
procedures   for  follow-up  of  vo-tech  center  annual   program   reviews. 


CHAPTER    II 
BACKGROUND 

The  Office  of  Public  Instruction  (OPI)  was  established  by 
Section  I,  Article  VI  of  the  Constitution  of  Montana.  The  Superin- 
tendent of  Public  Instruction  is  elected  to  a  four-year  term  and  is 
responsible  for  the  general  supervision  of  the  public  school  dis- 
tricts in  Montana.  The  superintendent  is  also  the  ex-officio  secre- 
tary of  the  State  Board  of  Education  and  the  sole  agent  responsi- 
ble for  development  of  policies  and  procedures  which  govern 
vocational  education   in  Montana. 

OPI  provides  consultative  and  technical  assistance  in  plan- 
ning, implementing  and  evaluating  educational  programs  in  such 
areas  as  teacher  preparation,  teacher  certification,  school  accred- 
itation, school  curriculum,  school  finances  and  school  law.  The 
office's  activities  are  organized  under  four  departments  each 
headed  by  an  assistant  superintendent.  The  Assistant  Superinten- 
dent for  Vocational  Education  Services,  who  heads  the  Department 
of  Vocational  Education  Services,  is  responsible  for  administering 
vocational  education  policies  adopted  by  the  Superintendent  of 
Public   Instruction. 

DEPARTMENT  ORGANIZATION   AND   STAFFING 

The  following  chart  depicts  the  current  organizational  struc- 
ture of  the  Department  of  Vocational   Education   Services. 


ORGANIZATION  OF  THE  DEPARTMFNT  OF  VOCATIONAL  EDUCATION  SERVICES 
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Source:   Office  of  Public  Instruction 

Illustration  1 

Department  staffing  has  decreased  over  the  past  few  years 
from  a  total  of  25  FTE  in  fiscal  year  1977-78  to  the  present  level 
of  15.5  FTE,  The  15.5  FTE  consist  of  a  planning  and  reporting 
specialist,  specialists  for  five  progrnm  areas,  specialists  for  three 
support  areas,  a  half-time  Native  American/Special  Needs/Dls- 
advantaqed  specialist,  the  executive  assistant,  the  assistant  super- 
intendent,  and   four  clerical   staff. 


DEPARTMENT   EXPENDITURES 

Department    expenditures    for    the    past    three    fiscal    years    are 
shown   in   the  following   illustration. 


DEPARTMENT 

EXPENDITURES   - 

UNAUDITED 

Fiscal 

Years  1981-82  to 

1983-84 

' 

Fiscal  Year 

Fiscal  Year 

Fiscal  Year 

Expenditure  Categories 

1981-82 

1982-83 

1983-84 

Salaries 

$360,302 

$386,281 

$430,981 

Hourly  Wages 

-0- 

2,739 

223 

Employee  Benefits 

67,327 

71,207 

82,809 

Contracted  Services 

20,684 

34,594 

18,239 

Supplies  and  Materials 

2,427 

3,837 

3,885 

Communications 

15,352 

16,369 

17,622 

Travel 

46,064 

42,185 

43,760 

Rent 

2,897 

1,460 

10 

Repairs  and  Maintenance 

568 

546 

3,070 

Other  Expenses 

2,992 

3,139 

9,180 

Equipment 

8,037 

723 

3,182 

Total 

$526,650 

$563,080 

$612,961 

Includes  Comprehensive  Employment  Training  Act  (CETA)  and  Job 
Training  Partnership  Act  (JTPA)  funding  as  coordinated  through 
the  Montana  Department  of  Labor  and  Industry. 

Source:   Statewide  Budgeting  and  Accounting  System 

Illustration  2 


DEPARTMENT  RESPONSIBILITIES 

Specific  responsibilities  of  the  Assistant  Superintendent  for 
Vocational  Education  Services  and  the  department  as  specified  in 
section   20-7-302.1,   MCA,    include: 


1.  administering  the  vocational  education  policies  adopted  by  the 
Superintendent  of  Public   Instruction; 

2.  preparing  curriculum  guides  for  adoption  by  Superintendent 
of  Public   Instruction; 

3.  employing,  with  the  confirmation  of  the  Superintendent  of 
Public  Instruction,  the  professional  staff  necessary  for  the 
state  supervision  and  administration  of  vocational  education; 

4.  reporting  the  status  of  vocational  education  in  Montana  when 
requested  by  the  Superintendent  of  Public   Instruction; 

5.  keeping   vocational  education   records; 

6.  providing  vocational  education  supervisory  and  consultative 
assistance  to  various  school  districts; 


9. 


preparing   reports  for  the  Superintendent  of  Public   instruction 
and/or  the   Legislature; 

providing    for   the   evaluation    of  vocational   education    programs 
and   services;   and 

performing   any   other   duty  assigned   by   the   Superintendent  of 
Public   Instruction. 


VOCATIONAL  FUNDING 

Secondary  and  postsecondary  vocational  education  programs 
and  activities  are  funded  by  state  General  Fund  allocations,  federal 
funds  under  the  Education  Amendments  of  1976,  and  local  funds. 
The  relationship  between  federal,  state,  and  local  funding  of 
vocational  programs  in  fiscal  years  1982-83  to  1983-84  is  shown  in 
Illustration   3. 


TOTAL   FEDERAL,    STATE,    AND   LOCAL    FUNDING 
FOR   SECONDARY  AND    POSTSECONDARY   VOCATIONAL   EDUCATION   -   UNAUDITED 
Fiscal  Years    1982-83   and    1983-84 


Sources 

Federal 

State 
Secondary 
Postsecondary 
Administration   of 
Federal   Programs 

Local 
Secondary 


Postsecondary 
Total 


1 


Fiscal  Year  1982-83 


Fiscal  Year  1983-84 


Percent 

Percent 

of 

of 

Total 

Total 

Funding 

Funding 

Funding 

Funding 

$  2,363,678 

10% 

$  2,692,387 

10% 

750,000 

3% 

750,000 
5,179,351 

3% 

5,250,455 

?1% 

20% 

318,512 

1% 

328,388 

1% 

13,177,484 

54% 

14,158,712 

54% 

2,567,493 

11% 

3,239,121 

12% 

$24,427,622 

100% 

$26,347,959 

100% 

1 


Includes  county  millage,  student  tuition  and  additional  voted 
2  millage. 

Includes  state  general  fund  and  coal  tax  moneys. 


Source:   Office  of  Public  Instruction 

Illustration  3 


Federal  funds  are  distributed  by  the  department  to  local  areas 
based  on  a  variety  of  federally  mandated  criteria  such  as  relative 
concentration  of  low  income  families,  economically  depressed  areas 
(counties  with  high  unemployment) ,  areas  with  greater  high  school 
dropout  rates,  and  relative  financial  ability  (district  property 
wealth).  Local  areas  apply  to  the  department  with  requests  for 
proposals  (RFPs)  for  these  funds.  The  requests  are  reviewed  by 
department  staff  according  to  two  criteria:  1)  program  quality; 
and  2)  priority  ranking  based  on  the  previously  described  factors. 
A  50  percent  overall  funding  match  by  local  areas  is  required. 
Illustration  4  shows  federal  vocational  funds  Montana  received 
during   fiscal  years   1982-83  and   1983-84. 


FEDERAL  VOCATIONAL  EDUCATION  FUNDS  -  UNAUDITED 
State  Fiscal  Years  1982-83  and  1983-84 


Section  120  Basic  Grant 

Disadvantaged 

Handicapped 

Apprenticeship 

Postsecondary 
Vo-Tech  Centers 
State  Administration 

Displaced  Homemaker 

Sex  Bias 
Total  Section  120  Funds 


Fiscal  Year 

1982-83 

Available 

Program  Funds 


369,959 

184,979 

60,000 


1,000,046 

174,810 

10,000 

50,000 


Fiscal  Year 

1983-84 

Available 

Program  Funds 


424,676 

212,338 

60,000 


1,178,657 

187,710 

10,000 

50,000 


1,849,794 


2,123,381 


Section  130 
Program  Improvement 

Disadvantaged 

Handicapped 

State  Administration 

Guidance 

Exemplary 
(Pilot  Programs) 

Curriculum 

Teacher  Development 

Research 
Total  Section  130  Funds 


67,719 
33,860 
40,000 
67,719 

10,000 
12,770 
82,155 
24,374 


76,067 
38,034 
41,256 
76,067 

17,138 
32,365 
73,929 
25,480 


338,597 


380,336 


Section  140 

Special  Needs 
Section  150 

Consumer  Homemaklng 
Section  102  D 

State  Plan  &  Related 
Vocational  Reports 

Federal  Funds  Total 


53,453 
108,474 

13,360 
$2,363,678 


54,633 
120,383 

13,654 
$2,692,387 


Source:   Office  of  Public  Instruction 


Illustration  4 
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Major     federal     legislation     related     to     vocational     education     is 
outlined  below: 


1963  The    Vocational    Education    Act    of    1963    was    enacted   1)    to 

extend  programs  previously  authorized  and  to  develop 
new  programs,  2)  to  encourage  research  and  experimen- 
tation, and  3)  to  provide  work  study  programs  to  encour- 
age youth  to  continue  in  vocational  programs.  The  act 
also  authorized  funds  for  the  construction  of  area  voca- 
tional  facilities. 

1968  The    Vocational    Education    Amendments    of    1968    authorized 

federal  grants  to  the  states  to  assist  them  to  maintain, 
extend,  and  improve  existing  vocational  education  pro- 
grams. These  grants  also  provide  part-time  employment 
for  youths  who  need  the  earnings  from  such  employment 
to  continue  their  vocational  training  on  a   full-time  basis. 

1976  The     Education     Amendments     of     1976     emphasized     equal 

opportunities  for  women  and  services  to  the  disadvantaged 
and  handicapped  but  eliminated  specific  allocations  to 
programs  like  work  study,  research,  and  cooperative 
vocational  education  in  an  attempt  to  give  states  more 
flexibility  and  options  in  allocating   federal   dollars. 

198i»  The    Carl    Perkins    Vocational    Education    Act    of    1984    was 

recently  passed.  The  bill  includes  provisions  to  direct 
education  and  training  efforts  more  towards  special 
populations,  to  decrease  federal  funding  for  state 
administration,  and  to  relax  local  regulations.  The  bill 
may  increase  local  and   state  administrative  burdens. 


Each  state  that  receives  federal  moneys  for  vocational  educa- 
tion must  establish  a  state  advisory  council  for  vocational  educa- 
tion. The  Montana  Advisory  Council  for  Vocational  Education 
(MACVE)  consists  of  23  members  appointed  by  the  Superintendent 
of  Public  Instruction.  The  council  hires  an  executive  director  to 
administer  its  activities.  MACVE's  major  responsibility  is  to  advise 
the  Office  of  Public  Instruction  on  both  secondary  and  post- 
secondary  vocational  education  concerns. 
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CHAPTER    III 

SECONDARY   VOCATIONAL   EDUCATION 

Currently,  there  are  169  secondary  schools  (grades  9  -  12)  in 
Montana  which  offer  career  exploratory,  prevocational,  and  voca- 
tional coursework  and  guidance.  Student  ANB  (Average  Number 
Belonging)  enrollment  for  fiscal  years  1982-83  and  1983-84  by  pro- 
gram  for  secondary   schools   is  shown   in  the  following   illustration. 


SECONDARY    STUDENT   ANB   ENROLLMENT    BY    PROGRAM 
Fiscal  Years   1982-83   and   1983-84 


Program 

Agriculture /Agribusiness 
Business  and  Office 
Home  Economics/Consumer  Homemaklng 
Marketing/Distributive  Education 
Industrial  Arts 
Trade  and  Industry 
Total 


Fiscal  Year 

Fiscal  Year 

1982-83 

1983-84 

3,236 

3,120 

5,906 

5,581 

7,835 

8,228 

1,053 

1,058 

3,619 

3,039 

3,509 

3,398 

25,158 

24,424 

These  figures  include  students  in  more  than  one  program. 
Source:   Office  of  Public  Instruction 

Illustration  5 

SECONDARY  VOCATIONAL  EDUCATION  PROGRAMS 

The  department  has  developed  secondary  vocational  education 
programs  in  Consumer  Homemaking  and  Home  Economics,  Business 
and  Office,  Marketing/Distributive  Education,  Trade  and  Industry, 
and  Agriculture/Agribusiness.  The  department  has  also  estab- 
lished an  Industrial  Arts  prevocational  program.  A  department 
specialist  is  assigned  to  each  of  these  programs  to  provide  techni- 
cal assistance  and  evaluate  the  programs  and  their  administration. 
The  department  has  developed  vocational  guidelines  for  Health 
Occupation  programs,  but  there  are  currently  no  such  programs  at 
the  secondary   level. 
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In  all  program  areas  except  Industrial  Arts  the  department 
has  developed  guidelines  for  cooperative  vocational  programs  which 
include  on-the-job  experience  and  training  provided  by  local 
employers,  along  with  vocational  classroom  instruction.  The 
department  also  has  support  specialists  in  Human  Potential  Develop- 
ment, Special  Needs,  and  Vocational  Guidance  Services.  The 
federally  mandated  Human  Potential  Development  specialist  handles 
potential  problems  in  the  areas  of  sex  discrimination,  equal  employ- 
ment opportunity,  and  the  displaced  homemaker  program.  The 
Special  Needs  specialist  provides  assistance  for  disadvantaged, 
handicapped,  and  special  needs  populations.  The  specialist  for 
Vocational  Guidance  Services  provides  career  guidance  counseling 
assistance  and  performs  Office  of  Civil   Rights   (OCR)    reviews. 

STATE  EXCESS  COST  FUNDING 

The  state  excess  cost  funding  of  secondary  vocational  educa- 
tion programs  is  based  on  the  concept  that  vocational  education 
programs  are  more  costly  to  operate  than  other  high  school  pro- 
grams. The  excess  cost  funding  is  allocated  to  the  secondary 
schools  based  on  vocational  program  costs  and  the  average  number 
belonging  (ANB)  in  a  particular  program.  These  funds  can  be 
used  for  seven  vocational  expenses:  instructional  supplies; 
instructional  salaries;  major  equipment;  extended  contracts; 
stipends  for  advising  vocational  student  organizations;  and  mainte- 
nance and/or  leasing  of  equipment. 

The  Legislature  has  appropriated  $750,000  per  year  since 
fiscal  year  1979-80  to  cover  some  of  the  excess  costs  of  operating 
secondary  vocational  programs.  This  level  of  state  funding  has 
averaged  about  27  percent  of  the  total  excess  costs  during  the 
period  covering  fiscal  year  1979-80  to  fiscal  year  1983-84.  The 
remaining  excess  costs  are  paid  by  the  local   school  districts. 
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DEPARTMENT  ACTIVITY    RELATED   TO   SECONDARY   VOCATIONAL 
EDUCATION 

Local  school  administrators  and  school  boards  are  responsible 
for  the  operation  of  vocational  education  programs  within  estab- 
lished state  and  federal  guidelines.  The  department  has  a  super- 
visory role  over  these  secondary  vocational  programs  and  activ- 
ities. The  department's  major  activities  in  the  secondary  voca- 
tional education  area  are  the  reviews  of  project  applications, 
program  evaluations,  the  collection  of  follow-up  information  on 
former  vocational  students,  student  organizations,  and  technical 
assistance.      Each  of  these  is  discussed   in  the  following   sections. 

Project  Applications 

Section   20-7-305f3),   MCA,    requires  school   districts   to  operate 
a  secondary  vocational  education   program  or  project  on  an  approved 
basis   for  one  year  to  become  eligible  for  state  excess  cost  funding. 
To    apply     for     this     funding,     schools     must     submit     the     following 
information   to  the  Department  of  Vocational   Education   Services: 

1.  Local   Plan   for  Vocational   Education; 

2.  Proposal  for  a  New  Secondary  Vocational  Education  Program  or 
Proposal  for  Renewal  of  a  Secondary  Vocational  Education 
Program; 

3.  Secondary  Vocational   Education   Student   Enrollment   Report; 

4.  Certified  Expenditure  Report  for  a  Vocational  Education 
Program; 

5.  Authorization   of  Vocational   Education   Personnel; 

6.  Addendum  for  a  Cooperative  Vocational  Education  Program; 
and 

7.  Self-Evaluation   for  a  Vocational   Education   Program. 


The  department  staff  reviews  the  applications  and  determines 
eligibility  for  excess  cost  funding.  The  project  application  and 
renewal  process  is  on  a  three-year  cycle  (an  annual  local  plan  and 
two  annual   renewal   plans). 
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Secondary  Vocational   Program  Evaluations 

Federal  regulations  require  that  each  state  evaluate  within  a 
five-year  period  the  effectiveness  of  each  vocational  program  that 
receives  federal  funding.  The  Department  of  Vocational  Education 
Services  is  currently  completing  a  three  region/three-year  program 
evaluation  cycle  during  fiscal  year  1984-85.  These  evaluations 
consist  of  an  on-site  evaluation  of  the  vocational  education  pro- 
grams and  activities  at  the  applicable  schools  by  a  team  of  depart- 
ment staff.  The  department  will  be  evaluating  schools  in  the 
eastern  region  during  the  1984-85  school  year.  The  following  map 
shows  these  regions. 

DEPARTMENT  EVALUATION  REGIONS 


Source:   Office  of  Public  Instruction 

Illustration  6 
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Secondary  Vocational   Student   Follow-up   Information 

Federal  and  state  regulations  require  annual  follow-up  of 
former  vocational  students.  Follow-up  data  on  former  vocational 
students  is  used  to  measure  the  success  of  a  vocational  program  or 
of  the  statewide  vocational  system.  The  department  will  be  com- 
pleting the  three  region/three-year  follow-up  cycle  of  secondary 
school  graduates  during  the  1984-85  school  year.  The  current 
system  was  started  during  school  year  1982-83  and  consists  of 
conducting  follow-up  in  one  of  the  three  evaluation  regions  each 
year  during   the  three-year  period. 

Student  Organizations 

Vocational  student  organizations  are  required  for  Agriculture/ 
Agribusiness  and  Marketing/Distributive  Education  vocational 
programs.  Currently  there  are  active  student  organizations  such 
as  Future  Farmers  of  America  (FFA)  and  Distributive  Education 
Clubs  of  America  (DECA)  in  all  secondary  vocational  program 
areas.  Department  program  specialists  assist  elected  officers  of 
the  student  organizations  in  scheduling  and  organizing  conferences 
and  student  related  activities.  Student  organizations  give  the 
student  an  opportunity  to  develop  leadership  potential  by  engaging 
in  student  initiated  civic,  educational,  professional,  and  social 
activities  that  are  supervised  by  vocational  instructors  and 
administered  by  school  officials. 

Technical  Assistance 

Department  specialists  also  provide  secondary  school  adminis- 
trators, school  board  members  and  teachers  technical  assistance 
with  the  schools'  vocational  programs  and  activities  through  visits, 
telephone  calls,  and  written  correspondence.  Assistance  consists 
of  providing  materials  and  input  related  to  vocational  seminars, 
workshops,   and  the  schools'  vocational   program  curriculum. 
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CHAPTER    IV 

POSTSECONDARY   VOCATIONAL  EDUCATION 
AT   VOCATIONAL-TECHNICAL  CENTERS 

In  1969  the  Legislature  authorized  the  postsecondary  vo-tech 
centers  to  offer  educational  and  training  programs  for  the  semi- 
skilled, skilled,  and  technical  occupations  including  programs 
which  allow  advancement  to  apprenticeship,  job  entry,  or  reentry. 
Student  FTE  enrollment  levels  for  the  five  vo-tech  centers  for 
fiscal  years  1982-83  and  1983-84  are  depicted  in  the  following 
illustration. 

VO-TECH   CENTER   STUDENT   FTE   ENROLLMENT* 
Fiscal  Years   1982-83   and   1983-84 


Center 

Billings   Vo-Tech 
Butte   Vo-Tech 
Great   Falls  Vo-Tech 
Helena  Vo-Tech 
Missoula  Vo-Tech 
Total 


Fiscal  Year 

Fiscal  Year 

1982-83 

1983-84 

549 

485 

341 

342 

461 

449 

728 

663 

586 

607 

2,665 

2,546 

*  FTE    enrollment    based    on    12th    day    enrollment    reports    using    1,000 
contact   hours  per   FTE. 


Source:      Compiled  by   the  Office   of   the  Legislative  Auditor 


Illustration   7 


GOVERNANCE  OF  THE  VO-TFCH    CENTERS 

From  1939  until  1972,  postsecondary  vocational  programs  were 
governed  by  the  State  Board  of  Education.  High  schools  provided 
postsecondary  vocational  training  until  fiscal  year  1968-69  when  the 
vo-tech  system  was  created.  The  system  includes  postsecondary 
vo-tech  facilities  in  Helena,  Missoula,  Butte,  Billings,  and  Great 
Falls. 
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The  1972  Montana  Constitution  created  the  Board  of  Public 
Education.  From  1972  until  1979,  the  Board  of  Public  Education 
governed  the  vo-tech  centers. 

Chapter  598,  Laws  of  1979,  designated  the  Superintendent  of 
Public  instruction  as  the  sole  agent  responsible  for  development  of 
policies  and  procedures  which  govern  vocational  education  in 
Montana.  The  Assistant  Superintendent  for  Vocational  Education 
Services,  appointed  by  the  Superintendent  of  Public  Instruction, 
presently  administers  all  secondary  vocational  education  programs 
and  postsecondary  vocational  education   programs  at  vo-tech  centers. 

VO-TECH   CENTER   EXPENDITURES 

Vo-tech  center  expenditures  for  fiscal  year  1983-8'4  are 
included   in    Illustration   8. 


VO-TECH 

CENTERS 

EXPENDITURES  BV  SOURCE  -  UNAUDITED 

Fiscal  Year  1983-84 

Additional 

General 

Federal 

County 

Student 

Voted 

Vo-Tech  Center 

Funds 

Funds 

Mlllage 

Tuition 

Coal 

Tax 

Mlllage  * 

Total 

Billings 

S  679,739 

$ 

167,369 

$302,993 

S  242,820 

$117, 

,930 

$140,000 

$1 

,650,851 

Butte 

631,242 

261,190 

77,283 

178,695 

79, 

,736 

125,000 

1 

,353.146 

Great  Falls 

575,986 

247,754 

143,931 

241,065 

182, 

,652 

135,000 

1 

,526,388 

Helena 

1.250,510 

281,228 

87,682 

343,530 

117, 

,93i 

149,690 

2 

,230,571 

Missoula 

1,281,707 

221,116 

211,862 

297,000 

117, 

,931 

297,854 

2 

,427,470 

Total 

$4,419,184 

11 

,178,657 

$823,751 

$1,303,110 

$616, 

,180 

$847,544 

$9 

,188,426 

Percent  of 

Total  Expenditures     iSX 

13X 

9X 

14X 

71 

9J: 

1003 

*  The  Additional  Voted  Mlllage  funds  are  not  appropriated  by  the  Legislature. 
Source:   Office  of  Public  Instruction 

Illustration  8 


HOUSE  JOINT   RESOLUTION   U6 

In  1981,  the  '♦7th  Legislature  expressed  concerns  regarding 
the  need  to  review  statutes  and  funding  methods  relating  to  the 
postsecondarv  vo-tech  centers.  As  a  result  of  these  concerns,  the 
Legislature  enacted  House  Joint  Resolution  46.  The  resolution 
requested  the  Legislative  Finance  Committee  to  study  alternative 
methods  for  funding  the  centers  and  to  review  the  statutes  related 
to    postsecondary    vocational    education    centers    so    that    necessary 
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clarification,  revision,  and  consolidation  of  the  provisions  could  be 
identified.  As  a  result  of  its  study,  the  Legislative  Finance 
Committee  recommended  a  change  in  the  formula  for  funding  the 
vo-tech  centers. 

In  response  to  the  Legislative  Finance  Committee's  request  for 
review  of  vocational  education  laws,  the  Department  of  Vocational 
Education  Services  prepared  a  proposal  to  consolidate  the  post- 
secondary  vocational  laws  in  November  1983.  The  Legislative 
Fiscal  Analyst's  staff  presented  options  to  the  Legislative  Finance 
Committee  in  July  198M.  Based  on  review  of  the  consolidation 
proposal,    the  Committee  voted  to  support  several   statutory  changes. 

POSTSECONDARY   VOCATIONAL  EDUCATION    PROGRAMS 

The  department  has  established  postsecondary  vocational 
education  programs  in  Agriculture,  Business  and  Office,  Distribu- 
tive/Marketing, Health  Occupations,  Home  Economics,  and  Technical 
and  Trades.  The  department  also  provides  assistance  in  support 
areas  such  as  Occupational  Outlooks,  Special  Needs,  and  Student 
Services.  Occupational  Outlooks  include  identifying  new  and 
emerging  occupations  based  on  current  job  supply  and  demand 
data,  and  job  placement  figures.  Special  Needs  provides  programs 
and  services  for  the  handicapped,  and  the  disadvantaged.  Student 
Services  includes  such  areas  as  vo-tech  center  admissions,  job 
placement,  guidance  and  counseling  activities,  and  financial  aid 
programs.  Department  specialists  are  assigned  to  each  of  these 
areas  for  on-site  evaluations  and  for  assistance  if  vo-tech  center 
personnel   request   help  in  completing  annual   program  self-reviews. 

DEPARTMENT   ACTIVITY    RELATED   TO    POSTSECONDARY 
VOCATIONAL  EDUCATION 

Vo-tech  center  directors  and  district  school  boards  are 
responsible  for  the  operation  of  vocational  programs  within  estab- 
lished state  and  federal  guidelines.  The  department  has  a  super- 
visory role  over  postsecondary  vo-tech  center  vocational  programs 
and    activities.       The    department's    major    postsecondary    vocational 


19 


education  activities  include  the  development  and  revision  of  policies 
and  procedures  which  govern  the  vo-tech  centers,  evaluation  of 
the  vn-tech  centers,  collection  of  follow-up  data  on  former  vo-tech 
center  students,  and  providing  technical  assistance  to  the  vo-tech 
centers.  The  department  also  provides  funding  for  apprenticeship 
training.      Each  activity   is  discussed   in   the  following   sections. 

Policies  and   Procedures  Manual 

The  Assistant  Superintendent  for  Vocational  Education  Services 
recommends  policies  and  procedures  to  the  Superintendent  of 
Public  Instruction  for  adoption  into  the  policies  and  procedures 
manual  for  postsecondary  vo-tech  centers.  The  Assistant  Superin- 
tendent also  holds  regular  meetings  with  vo-tech  center  directors 
and  vo-tech  school  district  superintendents  to  review  and  revise 
policies  and  procedures  governing  the  centers. 

Postsecondary  Vo-Tech   Center  Evaluations 

The  department  is  on  a  three-year  on-site  evaluation  schedule 
for  the  vo-tech  centers.  The  evaluation  process  is  based  on 
vocational  education  administrative  rules,  the  annual  program 
reviews,  and  on  guidelines  included  in  the  policies  and  procedures 
manual  for  use  during  on-site  vo-tech  center  evaluations.  The 
department  has  also  revised  the  annual  program  review  form  used 
by  the  vo-tech  centers  for  self-evaluation  of  programs  in  those 
years  the  center   is  not  given  a  department  on-site  evaluation. 

Follow-up  Data  on   Former  Vo-Tech   Center  Students 

Federal  and  state  regulations  require  annual  follow-up  of 
former  vocational  students  to  measure  the  success  of  vocational 
programs.  The  department  requires  collection  of  follow-up  data  by 
the  vo-tech  centers.  Follow-up  data  submitted  by  the  centers  is 
reported  to  the  federal  government  each   year. 
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Technical   Assistance 

Departnent  specialists  also  provide  the  vo-tech  center  admin- 
istrators, school  board  members  and  teachers  technical  assistance 
with  the  centers'  vocational  programs  and  activities.  Assistance 
consists  of  providing  materials  and  input  related  to  vocational 
seminars,  workshops,  and  center  vocational  program  curriculum 
during  visits,  and  through  telephone  calls  and  written  correspon- 
dence. 

Apprenticeship  Training 

The  department  funds  a  limited  number  of  apprenticeship 
training  hours  each  year  with  federal  vocational  education  funds. 
Apprentice  courses  provide  vocational  and  related  information  to 
individuals  pursuing  a  formal  apprenticeship  training  program  and 
registered  with  a   recognized  state  or  federal  apprenticeship  agency. 
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CHAPTER  V 

SCHOOL/CENTER   OPERATIONS 
AND    RELATED   DEPARTMENT  ACTIVITY 

This  chapter  discusses  the  effectiveness  of  school/center 
operations  and  related  department  activity.  Our  review  consisted 
of  independent  visits  to  fourteen  secondary  schools  and  the  five 
vo-toch  centers.  During  our  visits  we  toured  school/center  facil- 
ities, observed  school/center  operating  procedures,  examined 
records  and  interviewed  school /center  officials,  advisory  members, 
students  and  employers  of  vo-tech  center  graduates.  We  also 
examined   related  department  activity. 

SCHOOL/CENTER   VOCATIONAL  EDUCATION    PLANNING   ACTIVITY 

The  Department  of  Vocational  Education  Services  requires 
secondary  schools  to  submit  a  five-year  local  plan  for  vocational 
education  as  part  of  the  school's  application  for  state  excess  cost 
funding  of  its  vocational  education  programs.  Federal  and  state 
statutes  also  require  that  vo-tech  center  officials  submit  five-year 
plans  to  the  Office  of  Public  Instruction  for  approval.  The 
school/center  plans  provide  needed  information  to  the  department 
to  be  used  to  develop  the  state  vocational  education   plan. 

During  our  field  visits  we  reviewed  secondary  school  and 
vo-tech  center  planning  documents.  Schools  and  centers  were 
supposed  to  submit  five-year  plans  to  the  department  for  the 
planning  period  of  school  years  1982-83  through  1986-87.  We 
found  that,  although  secondary  school  officials  have  submitted 
planning  documents  to  the  department  for  approval,  the  secondary 
school  local  five-year  plans  are  not  true  planning  documents. 
These  school  plans  usually  lacked  detail  on  how  the  plan  would  be 
implemented  and  often  did  not  relate  to  school  needs  assessment, 
student/employer  follow-up  studies,  or  program  objectives.  In 
addition,  there  was  little  discussion  regarding  the  impact  of 
changes  in  student  enrollment,  instructional  costs  and  the  number 
of  instructors  on  a   program's  curriculum  and  equipment  needs. 
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The  department  requested  that  all  vo-tech  centers  submit  five 
year  plans  by  the  end  of  September  198U  (two  years  after  the 
beginning  of  the  planning  period).  We  found  that  as  of  Novem- 
ber 8,  1984,  four  center  plans  have  been  submitted  and  that  two 
plans  dre  inadequate.  The  plans  did  not  conform  to  the  depart- 
ment's planning  format  and  lacked  adequate  numerical  data,  projec- 
tions and  overall  goals  and  objectives. 

Some  school/center  officials  cited  a  lack  of  funding  and  re- 
search staff  as  reasons  for  not  completing  adequate  planning 
documents.  We  also  noted  that  some  officials  did  not  see  the  need 
for  extensive  planning  efforts  given  the  uncertainties  of  the  plan- 
ning  period  and  changes  in   technology. 

Without  adequate  school/center  planning,  school  and  center 
officials  operate  vocational  programs  that  may  not  have  adequate 
direction  and  the  department  lacks  adequate  data  on  school/center 
vocational  programs  and  activities  to  be  included  in  the  state 
vocational  education  plan.  In  addition,  school/center  vocational 
programs  may  not  be  meeting  student  and  community  needs  due  to 
inadequate  planning. 

The  department  has  recently  developed  a  format  for  vo-tech 
center  five-year  planning  documents.  The  new  format,  if  followed 
by  center  officials,  should  provide  improved  and  more  consistent 
center  planning.  The  department  should  revise  the  present  format 
for  secondary  school  vocational  education  planning  documents  so 
that  it  is  as  comprehensive  as  the  proposed  format  for  the  vo-tech 
centers.  The  department  should  also  enforce  plan  submission 
deadlines  and,  if  necessary,  apply  penalties  (probation  or  with- 
holding funds)  to  schools/centers  which  do  not  submit  planning 
documents   in  accordance   with   the  department   format  and  deadlines. 

RECOMMENDATION  #1 


WE  RECOMMEND  THE  DEPARTMENT: 

A.   REVISE  THE  PRESENT  FORMAT  FOR  SECONDARY  SCHOOL 
VOCATIONAL  EDUCATION  PLANNING  DOCUMENTS. 
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B.  REQUIRE  SCHOOLS/CENTERS  TO  COMPLY  WITH  DE- 
PARTMENT PLANNING  DOCUMENT  FORMATS  AND  DEAD- 
LINES. 


NEEDS  ASSESSMENTS 

Current  administrative  rules  require  that  vocational  education 
program  offerings  be  determined  on  the  basis  of  identifiable  stu- 
dent interest  and  need,  employment  statistics,  and  current  occupa- 
tional surveys.  During  our  field  work  we  found  that  13  of  14 
secondary  schools  and  all  vo-tech  centers  are  either  not  adequately 
determining  needs  related  to  vocational  education  or  not  determin- 
ing  such  needs  at  all. 

School  and  center  officials  have  not  determined  vocational 
education    needs    in    their   areas   for  a    number   of   reasons    including: 

1 )  they   do   not   know   how   to  conduct  a   needs  assessment   study;    or 

2)  they  do  not  have  adequate  funding/staffing  to  do  such  studies. 
Without  needs  information  the  secondary  schools,  vo-tech  centers, 
and  the  department  cannot  properly  determine  whether  present 
vocational  education  programs  are  meeting  public  needs  or  have  an 
adequate  basis  for  recommending  program  changes,  additions,  or 
deletions. 

Since  students  graduating  from  a  secondary  vocational  educa- 
tion or  vo-tech  center  program  will  not  necessarily  be  seeking 
employment  in  the  same  city  or  town  where  they  received  their 
vocational  education,  regional  needs  assessments  within  Montana 
may  be  a  better  way  to  determine  student  and  community  needs. 
If  regional  needs  assessments  are  conducted  by  the  department, 
the  school/centers  would  not  have  to  duplicate  efforts  to  collect 
the  same  types  of  needs  assessment  information  and  there  would  be 
more  consistency  in  the  needs  assessment  procedures  and  results. 
These  needs  assessments  should  include  information  such  as  student 
interests  and  needs,  employer  needs,  employment  statistics  and 
current  occupational   surveys. 

The  department  should  consider  conducting  periodic  regional 
vocational   needs  assessments  and  making   information  available  to  all 
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secondary  schools  and  vo-tech  centers.  The  department  should 
provide  the  schools/centers  assistance  in  the  use  of  the  regional 
needs  assessment  data.  The  regional  assessments  could  take  the 
place  of  most  ongoing  needs  assessments  presently  required  of  the 
schools  and  centers.  The  schools  and  centers  should  still  consider 
local  needs  in  determining  the  need  for  new  programs  and  for 
evaluating  current  programs.  The  department  should  also  consider 
establishing  specific  criteria  and  a  format  for  the  regional  needs 
assessment  studies  and  revising  administrative  rules  so  that  the 
secondary  schools  and  vo-tech  centers  would  not  be  required  to 
conduct  extensive  needs  assessments.  The  department  may  need 
additional  funding/staffing  to  conduct  these  regional  needs  assess- 
ments. 

RECOMMENDATION   #2 

WE   RECOMMEND   THE   DEPARTMENT: 

A.  CONDUCT     PERIODIC     REGIONAL    VOCATIONAL    EDUCA- 
TION  AND  OCCUPATIONAL   NEEDS  ASSESSMENTS  WITHIN 
MONTANA     AND     MAKE     THE     RESULTS     AVAILABLE     TO 
THE   SCHOOLS/CENTERS. 

B.  ESTABLISH  SPECIFIC  CRITERIA  AND  FORMAT  FOR  THE 
REGIONAL   NEEDS  ASSESSMENTS. 

C.  PROVIDE  SCHOOLS/CENTERS  ASSISTANCE  IN  THE  USE 
OF  THE    REGIONAL   NEEDS  ASSESSMENTS. 

D.  REVISE  ADMINISTRATIVE  RULES  SO  THAT  SCHOOLS/ 
CENTERS  ARE  NOT  REQUIRED  TO  CONDUCT  EXTEN- 
SIVE  NEEDS  ASSESSMENTS. 


STUDENT/EMPLOYER   FOLLOW-UP 

Current  administrative  rules  and  federal  regulations  require 
annual  follow-up  of  school/center  vocational  graduates  and  employ- 
ers. We  determined  that  six  of  the  fourteen  secondary  schools  we 
visited  conducted  follow-up  on  the  status  of  former  students  and 
only  one  of  these  schools  followed  up  on  the  employers  of  the 
vocationally   trained   students.      VJe   also   found    that   vo-tech    centers 
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are  doing  only  minimal  student/employer  follow-up  to  meet  federal 
reporting  reauirements.  School  and  center  officials  cited  a  number 
of  reasons  for  not  doing  adequate  student  follow-up  including: 
1)  inadequate  staff  expertise  to  conduct  follow-ups;  2)  inadequate 
staff/funding  to  perform  such  follow-ups;  and  3)  very  low  response 
levels  make   results  unreliable. 

Without  adequate  follow-up,  the  secondary  schools  and  vo-tech 
centers  cannot  determine  how  the  students  are  using  their  voca- 
tional education,  if  the  vocational  education  provided  met  their 
needs,  if  they  are  employed  in  the  field  for  which  they  were 
trained,  and  if  vocationally  trained  students  are  meeting  the  needs 
of  employers. 

During  our  review  we  also  found  areas  of  overlapping  fol- 
low-up of  secondary  school  graduates  by  the  Office  of  Public 
Instruction.  Roth  the  Department  of  Basic  Instruction  Services 
and  the  Department  of  Vocational  Education  Services  require  the 
schools  to  conduct  annual  student  follow-up.  In  addition,  the 
Department  of  Vocational  Education  Services  is  conducting  its  own 
regional  follow-up  of  secondary  school  graduates  who  have  taken 
vocational  courses  while  in  high  school.  Under  the  current  OPI 
secondary  graduate  follow-up  system,  there  may  be  unnecessary 
duplication  of  effort  by  both  departments.  Schools  and  both 
departments  expend  resources  to  gather  similar  data  on  the  status 
of  secondary  school  graduates. 

The  Office  of  Public  Instruction  should  develop  a  centralized 
student/employer  follow-up  system  to  conduct  follow-ups  and 
summarize  overall  and  individual  school/center  results  based  on 
names  and  addresses  provided  by  the  applicable  schools  and  vo- 
tech  centers.  This  system  should  include  information  necessary  to 
meet  federal  reporting  requirements.  Such  a  system  could  provide 
consistency  in  follow-up  procedures,  and  results  could  be  generated 
by  school,  center  or  on  a  statewide  basis.  The  Office  of  Public 
Instruction  should  also  revise  current  administrative  rules  and 
accreditation  standards  so  that  schools/centers  are  not  required  to 
conduct  student/employer  follow-up.  The  department  may  need 
additional   funding/staffing   to  conduct  centralized  student  follow-ups. 
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RECOMMENDATION   #3 

WE   RECOMMEND   THE  OFFICE  OF   PUBLIC    INSTRUCTION: 

A.  DEVELOP  A   CENTRALIZED   STUDENT/EMPLOYER    FOLLOW- 
UP  SYSTEM   THAT  WILL  MEET  VOCATIONAL  AND   ACCREDI- 
TATION   REQUIREMENTS. 

B.  PROVIDE  FOLLOW-UP  RESULTS  TO  THE  SCHOOLS/ 
CENTERS. 

C.  REVISE  ADMINISTRATIVE  RULES  AND  ACCREDITATION 
STANDARDS  SO  THAT  SCHOOLS/CENTERS  ARE  NOT 
REQUIRED  TO  CONDUCT  STUDENT/EMPLOYER  FOLLOW- 
UP. 


ADVISORY   COUNCILS/PROGRAM  ADVISORY   COMMITTEES 

The  department  has  established  administrative  rules  which 
require  that  vocational  education  programs  be  conducted  in  consul- 
tation with  advisory  councils/program  advisory  committees. 
Schools/centers  are  required  to  have  an  overall  school/center 
advisory  council  which  should  consist  of  a  representative  cross- 
section  of  management,  labor,  and  other  interested  community 
members.  Current  rules  also  require  an  advisory  committee  for 
each  vocational  program  area  at  a  school /center  except  for  secon- 
dary schools  which  have  three  or  fewer  program  offerings  and 
adequate  representation  on   the  school   advisory  council. 

During  our  field  visits  we  identified  a  number  of  inactive 
advisory  councils  and  program  advisory  committees  at  several 
secondary  schools  and  vo-tech  centers.  Although  members  have 
been  selected,  we  found  that  30  of  the  56  school/center  advisory 
councils/committees  we  examined  are  not  meeting  on  a  regular  basis 
and  do  not  provide  input  for  program  improvements.  During  our 
review  we  also  noted  that  three  of  the  advisory  committee  members 
(as  identified  on  school  listings)  we  contacted  were  not  aware  that 
they  were  on  a   school   program  advisory  committee. 

School/center  officials  cited  a  number  of  reasons  for  the 
inactive  advisory  councils/committees  including:  1)  councils/com- 
mittees  are   not   productive;    2)   councils/committees   are   not   given   a 
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high  priority  at  the  schools;  and  3)  they  find  it  difficult  to  get 
members  together  for  meetings  and  organize  activities.  Without 
active  advisory  councils/committees,  the  applicable  schools  are 
failing  to  use  a  source  of  input  regarding  curriculum  and  equip- 
ment needs   for  vocational  education   programs  and   facilities. 

During  our  review,  school/center  officials  and  advisory  mem- 
bers indicated  a  need  to  examine  the  role  of  advisory  councils/com- 
mittees. We  noted  that  some  school/center  officials  are  not  respon- 
sive to  council/committee  suggestions  and  do  not  provide  advisory 
members  adequate  feedback  concerning  school/center  implementation 
of  their  recommendations.  Several  school/center  officials  and 
advisory  members  noted  that  better  guidelines  for  council/committee 
operation   including  assignment  of  tasks   is  necessary. 

The   department   should   examine   the   role  and    requirements   for 
advisory  councils  and  program  advisory  committees.      The  department 
should    also    continue    to    provide    assistance    to    increase    advisory 
council/committee    participation    and    activities     in    cooperation     with 
the  Montana  Advisory   Council   for  Vocational   Education    (MACVE). 

RECOMMENDATION    #4 

WE   RECOMMEND   THE   DEPARTMENT: 

A.  EXAMINE  THE  ROLE  AND  CURRENT  REQUIREMENTS 
FOR  ADVISORY  COUNCILS  AND  PROGRAM  ADVISORY 
COMMITTEES. 

B.  CONTINUE  TO  PROVIDE  ASSISTANCE  IN  COOPERATION 
WITH  MACVE  TO  INCREASE  ADVISORY  COUNCIL/ 
COMMITTEE   PARTICIPATION. 


VOCATIONAL  EDUCATION   CURRICULUM   DEVELOPMENT 

The  Department  of  Vocational  Education  Services  is  responsi- 
ble for  the  review  and  approval  of  secondary  school  and  vo-tech 
center  vocational  curriculum  and  has  a  process  in  place  to  perform 
this  function.  The  department  uses  national  curriculum  models  to 
provide     general     guidelines     for     vocational     program     curriculum. 
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During  fiscal  year  1983-84,  the  department  provided  $32,365  for 
curriculum  development  projects  which  consisted  of  instructional 
materials  and  curriculum  guides  developed  by  university   researchers. 

A  department  specialist  is  currently  completing  a  standardized 
core  curriculum  for  vo-tech  center  business  and  office  programs  as 
part  of  a  pilot  project.  We  noted  that  this  process  lacks  adequate 
direct  employer  input  regarding  the  competencies  or  skills  that 
graduates  of  a  business  and  office  program  should  have.  Without 
employer  input,  there  is  inadequate  assurance  that  the  core  cur- 
riculum will  meet  the  needs  of  employers. 

During  our  audit  work  we  identified  a  general  lack  of  formal 
vocational  education  curriculum  development  and  review  activities 
at  the  secondary  school  and  vo-tech  center  levels.  Most  of  the 
schools  and  centers  have  an  informal  curriculum  development 
process  where  staff  members  can  propose  curriculum  changes. 
Current  administrative  rules  require  instruction  that  is  based  on 
the  analysis  of  the  skills  and  knowledge  needed  in  related  occupa- 
tional areas.  Curriculum  development  at  the  schools  and  centers 
does  not  include  formal  considerations  of  student  and  employer 
follow-up  studies,  needs  assessments,  and  advisory  committee 
input.  Most  schools/centers  also  do  not  have  a  formal  curriculum 
review  process  that  assures  periodic  review  of  the  adequacy  of 
their  curriculum. 

Some  school /center  officials  agree  that  there  is  a  need  to 
revise  certain  parts  of  their  vocational  curriculum  to  make  pro- 
grams more  responsive  to  employer  needs.  Other  officials  believe 
that  the  current  curriculum  development  procedures  are  adequate 
and  provide  sufficient  information  for  establishing  appropriate 
vocational  curriculum. 

Under  current  curriculum  development  and  review  procedures, 
there  is  little  assurance  that  the  present  curriculum  and  curricu- 
lum changes  are,  in  fact,  meeting  the  needs  of  the  students  and 
employers.  During  our  visits  to  the  vo-tech  centers  we  contacted 
a  sample  of  employers  regarding  the  adequacy  of  training  received 
by  former  center  students.  Some  employers  noted  deficiencies  in 
the     training     that     students     had     received     while     at     the     vo-tech 
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centers.  Several  employers  suggested  that  the  curriculum  needs 
to  be  changed  or  expanded  to  provide  students  the  types  of  skills 
needed  on  the  job.  A  lack  of  formal  school/center  procedures  also 
makes  it  difficult  for  department  staff  to  adequately  evaluate 
school/center   vocational  education   curriculum. 

The  department  should  require  a  formal  vocational  education 
curriculum  development  and  review  process  be  implemented  at  the 
the  secondary  schools  and  vo-tech  centers.  The  department 
should  also  specify  the  types  of  information,  including  employer 
input,  that  school/center  officials  should  be  considering  during 
curriculum  development  and  review.  These  efforts  would  ensure 
that  school/center  officials  collect  adequate  data  to  develop  and 
review  curriculum  and  would  also  provide  the  department  with 
better  information  when  reviewing  school/center  vocational  educa- 
tion curriculum.  The  department  should  also  obtain  and  consider 
employer   input   as   part  of  its  core  curriculum  development  process. 

RECOMMENDATION    #5 


WE   RECOMMEND   THE   DEPARTMENT: 

A.  REOUIRE  A  FORMAL  VOCATIONAL  EDUCATION  CURRIC- 
ULUM DEVELOPMENT  AND  REVIEW  PROCESS  BE  IMPLE- 
MENTED   BY   SCHOOLS/CENTERS. 

B.  SPECIFY  TYPES  OF  INFORMATION  SCHOOL/CENTER 
OFFICIALS  SHOULD  BE  CONSIDERING  FOR  CURRICU- 
LUM  DEVELOPMENT   AND    REVIEW. 

C.  OBTAIN  AND  CONSIDER  EMPLOYER  INPUT  AS  PART  OF 
DEPARTMENT   CORE   CURRICULUM   DEVELOPMENT   PROCESS. 


VOCATIONAL   TEACHER   DEVELOPMENT 

Current  administrative  rules  require  the  development  of 
vocational  teachers'  competencies  and  improvement  of  their  occupa- 
tional skills.  Individual  teachers,  school/center  administrators, 
teacher  training  institutions  and  department  officials  share  the 
responsibility  to  ensure  that  teachers  develop  and  maintain 
adequate     competencies     and     skills.        During     our     field     work     we 
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reviewed   vocational    teacher   development   activities   at   fourteen   high 
schools  and   the  five  vo-tech  centers. 

We  found  inadequate  vocational  teacher  development  at  seven 
high  schools  and  three  of  the  five  vo-tech  centers  visited.  None 
of  these  schools  and  centers  have  teacher  development  plans, 
although  some  schools  and  centers  have  provided  incentives  for 
teacher  development  through  local  negotiated  teacher  agreements. 
We  also  found  that  some  school/center  vocational  teachers  have  had 
only  limited  or  no  in-service  training  during  the  past  three  years. 
In  addition,  most  of  the  training  received  by  teachers  was  not 
related  to  their  vocational  teaching  areas. 

School/center  officials  cited  various  reasons  for  inadequate 
teacher  development  including:  1)  teachers  are  not  taking  advan- 
tage of  opportunities  and  incentives  already  in  place;  and  2)  inad- 
equate resources  to  provide  additional  teacher  development  oppor- 
tunities. 

Procedures  and  equipment  within  various  vocations  are  chang- 
ing constantly.  Without  continual  updating  of  vocational  teachers' 
knowledge/skills  and  teaching  methods,  the  teachers  cannot  pro- 
vide students  with  up-to-date  training. 

The  department  has  distributed  federal  vocational  funds  for  a 
number  of  teacher  development  seminars,  conferences,  and  work- 
shops. Department  specialists  administer  some  of  the  teacher 
development  conferences  and  workshops.  During  fiscal  year 
^983-8^,  department  officials  allocated  about  $85,300  for  teacher 
development.  The  department  has  funded  a  fiscal  year  1984-85 
Back  to  Industry  Teacher  and  Professional  Development  Project  for 
$43,000. 

The  department  should  consider:  1)  additional  regional 
training  sessions  for  vocational  teachers  in  their  chosen  fields  of 
instruction;  and  2)  proposing  to  the  Board  of  Public  Education, 
the  development  of  specific  requirements  that  vocational  teachers 
take  at  least  a  minimum  number  of  trade-related  courses  over  a 
specified  time  period.  If  adequate  federal  funding  is  not  available 
for  additional  regional  training  sessions,  additional  local/state 
funds  may  be  needed. 
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RECOMMENDATION    #6 

WE   RECOMMEND   THE   DEPARTMENT: 

A.       PROVIDE    ADDITIONAL    REGIONAL    TRAINING    SESSIONS 
FOR   VOCATIONAL   EDUCATION   TEACHERS. 

R.       PROPOSE      TO      THE      BOARD      OF      PUBLIC      EDUCATION 
SPECIFIC    REQUIREMENTS   THAT   VOCATIONAL  TEACHERS 
TAKE     AT      LEAST     A     MINIMUM      NUMBER     OF     TRADE- 
RELATED   COURSES   OVER   A   SPECIFIED   TIME   PERIOD. 


TEACHER   CERTIFICATION 

Current  administrative  rules  require  secondary  and  vo-tech 
center  vocational  education  teachers  to  satisfy  minimum  occupational 
and  professional  certification  standards  established  by  the  Board  of 
Public  Education  and  meet  applicable  recertification  standards. 
The  Department  of  Basic  Instruction  Services  reviews  teacher 
certification  at  the  K-12  levels  and  performs  the  record-keeping 
function  for  vocational  education  teacher  certification.  The  De- 
partment of  Vocational  Education  Services  also  reviews  vocational 
education  teacher  certification  at  schools  and  centers  as  part  of  its 
evaluation   process. 

During  our  field  work  we  reviewed  the  certification  status  of 
36  secondary  school  vocational  education  teachers  and  30  teachers 
at  the  vo-tech  centers.  We  found  five  noncertified  teachers  and 
one  teacher  who  is  teaching  outside  his  area  of  endorsement  at  the 
vo-tech  center  level  and  one  noncertified  teacher  at  the  secondary 
school  level.  This  represents  ten  percent  of  the  vocational  educa- 
tion  teachers  we   reviewed. 

The  Department  of  Vocational  Education  Services'  evaluation 
process  reviews  teacher  certification  as  a  compliance  issue  but  the 
certification  information  is  not  used  to  follow  up  and  take  correc- 
tive action.  Department  officials  believe  that  the  county  super- 
intendent in  each  vo-tech  center  district  has  the  responsibility  of 
identifying   noncertified  teachers. 

During  our  review  we  noted  inadequate  coordination  between 
the  Department  of  Vocational  Education  Services  and  the  Depart- 
ment  of    Basic    Instruction    Services    regarding    teacher    certification 
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deficiencies  noted  during  on-site  evaluations,  in  addition,  neitlier 
of  the  departments  provide  information  to  county  superintendents 
regarding  noncertified  teachers  identified  during  department  evalua- 
tions of  the  schools/centers.  In  order  to  assure  compliance  with 
its  administrative  rules,  the  department  should  develop  and  coordi- 
nate procedures  which  verify  certification  of  vocational  education 
teachers. 

RECOMMENDATION    #7 

WE  RECOMMEND  THE  DEPARTMENT  DEVELOP  AND  COORDI- 
NATE PROCEDURES  WHICH  VERIFY  CERTIFICATION  OF 
VOCATIONAL  EDUCATION   TEACHERS. 


JOB   PLACEMENT/JOB   DEVELOPMENT  ACTIVITIES 

Current  administrative  rules  require  that  secondary  schools 
and  vo-tech  centers  provide  job  placement  services  for  their 
students.  Department  guidelines  note  that  the  job  placement 
system  should  include  coordinating  job  placement,  providing 
instruction  in  job-seeking  skills,  surveying  employment  needs  in 
the  community,  and  providing  input  for  adjustments  of  vocational 
education  curriculum  to  meet  identified  needs.  Department  guide- 
lines also  note  that  school  representatives  should  make  business 
and  industrial  contacts  outside  the  school  on  a  regular  basis  as 
part  of  the  job  development  activity.  Job  development  is  the 
process  of  seeking  and  identifying  potential  jobs  to  be  matched 
with  graduates  and/or  identifying  employers  who  are  willing  to  hire 
vocationally  trained  graduates  with  job  skills  as  jobs  become  avail- 
able within  their  organization. 

During  our  field  visits  we  examined  secondary  school  and 
vo-tech  center  job  placement  and  job  development  activities.  We 
found  that  job  placement  and  job  development  activity  was  inade- 
quate at  all  14  secondary  schools  and  at  all  five  vo-tech  centers 
that  we  visited.  Most  of  the  secondary  schools  provide  only 
limited  job  placement  and  job  development  activity.  Officials  at 
seven    secondary    schools    stated    that    providing    job    placement    and 
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job  development  is  not  and  should  not  be  a  function  of  secondary 
schools.  Vo-tech  centers  provide  more  job  placement  service,  but 
such  activity  is  still  not  adequate.  These  centers  have  just 
started  providing   minimal  job  development  activity. 

During  our  visits  we  also  noted  limited  efforts  by  the 
schools/centers  to  coordinate  job  placement  and  job  development 
activities  with  the  state's  Department  of  Labor  and  Industry,  Job 
Service  Division.  The  division  will  provide  limited  job  placement 
assistance  to  the  schools/centers  if  requested  by  school/center 
officials. 

During  our  audit  we  contacted  a  sample  of  graduates  from  the 
14  secondary  schools  and  five  vo-tech  centers.  Approximately 
32  percent  of  the  contacted  school/center  graduates  rated 
school/center  job  placement  activity  as  below  average  or  poor.  We 
also  identified  the  current  employment  status  of  those  school  year 
1982-83  school/center  graduates  who  indicated  that  they  entered 
their  vocational  program  area  with  the  intention  of  acquiring  job 
skills  and  getting  a  job  in  their  vocational  program  area.  We 
found  that  52  percent  of  the  school/center  graduates  taking  voca- 
tional training  to  acquire  job  skills  and  obtain  a  job  in  their  area 
of  training  were  either  unemployed  or  employed  in  an  occupational 
area  not  related  to  their  vocational  training.  These  figures  are 
shown   in    Illustration   9. 


34 


PERCENTAGE   OF    1982-83    SCHOOL/CENTER   GRADUATES 
NOT   EMPLOYED    IN  AREA   OF   VOCATIONAL   TRAINING 

High   School  Vo-Tech 

Graduates  Graduates 

Took  vocational   program  with    Intent 

to  acquire   job    skills   and   obtain 

a  job    in    their   area  of  vocational 

training  31%  64% 

Unemployed   or   employed    in   area   not 

related    to  vocationa]    training*  52%  52% 


*  Percentages  indicate  employment  status  of  those  respondents 
who  took  the  vocational  program  with  the  intent  to  acquire  job 
skills   and   obtain  a  job    in   their  area   of  vocational    training. 

Source:      Compiled   by    the   Office   of   the   Legislative  Auditor 

Illustration  9 

Our  survey  results  also  show  that  40  percent  of  the  1982-83 
high  school  graduates  are  currently  not  enrolled  in  postsecondary 
schools  (vo-tech  centers,  community  colleges,  universities,  and 
private  schools). 

There  appears  to  be  a  general  consensus  among  most  secon- 
dary school  officials  and  other  interested  parties  that  job  placement 
and  job  development  are  not  as  necessary  at  the  secondary  school 
level.  The  department  should  examine  the  need  for  job  placement 
and  job  development  at  the  secondary  level.  Based  on  this  exami- 
nation, the  department  should  propose  needed  administrative  rule 
revisions. 

The  department  should  also  ensure  that  centers  are  providing 
adequate  job  placement  and  job  development  services  since  a  signi- 
ficant number  of  vocational  students  enter  the  centers  with  the 
intention  of  acquiring  job  skills  for  job  entry  upon  program 
completion.  School/center  job  placement  and  job  development 
activity  should  be  coordinated  with  activities  of  the  state  Depart- 
ment of  Labor  and   Industry,   Job  Service  Division. 
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RECOMMENDATION   #8 

WE   RECOMMEND   THE   DEPARTMENT: 

A.  EXAMINE  THE  NEED  FOR  JOB  PLACEMENT  AND  JOB 
DEVELOPMENT  AT  THE  SECONDARY  SCHOOL  LEVEL 
AND    REVISE  ADMINISTRATIVE   RULES   ACCORDINGLY. 

B.  ENSURE   THAT   VO-TECH    CENTERS  ARE   PROVIDING   THE 
REOUIRED    LEVELS   OF  JOB   PLACEMENT   AND   JOB   DEVELOP- 
MENT  SERVICES. 

C.  COORDINATE    PLACEMENT    ACTIVITY    WITH    THE    STATE 
DEPARTMENT  OF   LABOR  AND    INDUSTRY,    JOB   SERVICES 
DIVISION. 


EQUIPMENT 

During  our  field  visits  we  examined  equipment  in  27  secon- 
dary and  10  vo-tech  center  vocational  education  programs.  Based 
on  our  review,  we  found  that  school /center  vocational  education 
equipment  was  generally  adequate  except  for  three  courses  within 
two  program  areas  which  lacked  needed  equipment.  These  areas 
included  an  automotive  class  which  needed  an  auto  body  frame 
repair  machine,  a  business  and  office  course  which  did  not  have 
adequate  word  processing  equipment,  and  a  trade  and  industry 
class  which   lacked  needed  heavy  equipment  machinery. 

Schools/centers  should  train  students  on  that  type  of  equip- 
ment used  in  industry.  Students  not  trained  on  equipment  cur- 
rently used  in  industry  cannot  effectively  compete  for  jobs  with 
other  students  that  have  trained  on  the  more  modern  equipment. 
In  addition,  students  not  trained  on  the  more  modern  equipment 
may  require  additional  training  on  the  new  equipment  once  they 
are  placed  on   the  job. 

During  the  audit  we  noted  that  the  centers  requested 
$1,251,197  in  equipment  funding  for  the  1985  biennium.  This 
figure  was  modified  by  the  assistant  superintendent  to  $884,400  for 
the  1985  biennium  which  represented  about  a  50  percent  increase 
in  equipment  funding  over  the  previous  biennium.  The  centers 
received     $428,019     in     equipment     funding    authority     for    the     1985 
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biennium.  However,  we  noted  thnt  center  officials  did  not  expend 
their  entire  fundinq  authority  even  though  they  had  noted  during 
our  visits  that  equipment  was  needed  in  several  programs.  We 
also  found  that  $165,073  of  additional  mill  levy  funding  was  not 
expended  by  the  centers  during  fiscal  year  1983-84.  Moneys  from 
additional  mill  levies  can  be  used  for  salaries  and  benefits, 
equipment,  and  operations  at  the  discretion  of  the  vo-tech  centers 
unless   restricted  by  specific  mill   levy  wording. 

During  the  audit  we  also  did  not  note  a  consistent  method  of 
identifying  school /center  vocational  education  equipment  needs  or 
procedures  to  ensure  timely  replacement  of  out-of-date  equipment. 
The  schools/centers  and  the  department  do  not  have  any  formal 
policies  or  procedures  regarding  determining  proper  equipment 
needs  or  replacing  out-of-date  equipment.  The  department  should 
establish  policies  and  procedures  to  ensure  that  vocational  program 
equipment  needs  are  being  met  and  out-of-date  equipment  is  being 
replaced  on  a  timely  basis. 

RECOMMENDATION   #9 

WE  RECOMMEND  THE  DEPARTMENT  ESTABLISH  POLICIES 
AND  PROCEDURES  FOR  DETERMINING  EQUIPMENT  NEEDS 
AND    REPLACEMENT  OF  OUT-OF-DATE   EQUIPMENT. 
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CHAPTER   VI 

DEPARTMENT  MANAGEMENT  OF  VOCATIONAL   EDUCATION 

This  chapter  discusses  areas  related  to  department  manage- 
ment of  vocational  education  including  management  information, 
department  evaluation  activities,  and  department  enforcement 
activities, 

MANAGEMENT    INFORMATION 

Current  administrative  rules   require  the  department  to  develop 
a   system   to  collect,    analyze,    interpret,    and   communicate   vocational 
education   information.      Secondary   schools   and   vo-tech   centers  also 
are     required     by    department    guidelines    to    maintain    and     provide 
vocational  education   information. 

During  our  field  visits  we  noted  that  some  schools/centers  are 
not  maintaining  and  analyzing  collected  data  nor  providing  the 
department  with  adequate  information.  For  example,  some 
schools/centers  had  not  tabulated  student  follow-up  results  or  used 
the  results  to  revise  vocational  program  curriculum.  We  also  noted 
that  the  schools/centers  did  not  have  adequate  data  on  the  number 
of  students  who  received  counseling,  the  number  of  students  who 
did  not  complete  vocational  programs  (program  attrition),  or 
program/class  waiting  lists.  The  data,  where  available,  was  often 
in  raw  form  and  not  summarized  for  use  by  school/center  adminis- 
trators. We  also  found  that  the  department  has  not  received 
appropriate  vo-tech  center  student  accident  information  identifying 
the  center  and  the  program  where  the  accidents  occurred. 

Without  adequate  management  information  being  maintained  and 
provided  to  the  department  by  the  schools/centers,  there  are 
inadequate  means  to  identify  weaknesses  and  problems  in  various 
vocational  education  programs,  as  well  as  inform  the  public  regard- 
ing vocational  education  activities.  The  department  should  assist 
schools/centers  in  developing  and  maintaining  better  management 
information.  The  department  should  also  review  the  adequacy  of 
present  guidelines   in   the  management   information   area. 
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During  the  audit  we  also  identified  areas  where  the  depart- 
ment could  further  improve  collection  of  management  information. 
These  areas  include  better  employee  time  summaries,  teacher 
certification  information,  summary  attrition  data,  program  demand 
levels,  and  earlier  identification  of  schools/centers  which  have  not 
submitted  planning  documents  or  have  not  been  evaluated  during 
the  five-year  evaluation  period.  The  department  should  improve 
its  procedures  to  assure  collection  of  adequate  management  infor- 
mation. 

RECOMMENDATION    #10 

WE   RECOMMEND   THE   DEPARTMENT: 

A.  ASSIST  SCHOOLS/CENTERS  IN  DEVELOPING  BETTER 
MANAGEMENT    INFORMATION   SYSTEMS. 

B.  REVIEW  ADEQUACY  OF  PRESENT  DEPARTMENT  GUIDE- 
LINES IN  THE  MANAGEMENT  INFORMATION  AREA  FOR 
SECONDARY   SCHOOLS/VO-TECH   CENTERS. 

C.  IMPROVE  PROCEDURES  TO  ENSURE  COLLECTION  OF 
ADEQUATE  MANAGEMENT    INFORMATION. 


DEPARTMENT   ON-SITE   EVALUATION    PROCESS 

The  Department  of  Vocational  Education  Services  is  required 
by  statute  and  administrative  rule  to  evaluate  the  effectiveness  of 
each  funded  vocational  education  program  within  a  five-year  period. 
The  department  is  currently  on  a  three-year  on-site  program 
evaluation  cycle  for  both  the  vo-tech  centers  and  the  secondary 
schools. 

The  department  on-site  evaluation  team  consists  of  department 
administrators,  program  specialists  and  support  specialists.  Each 
member  of  the  team  completes  an  evaluation  form  for  their  applica- 
ble vocational  program  areas.  The  evaluation  team  also  examines 
the  administration  of  the  school/center  programs.  The  program 
evaluation  instruments  used  for  the  school/centers  are  based  on 
program  standards  contained  in  the  administrative  rules  and  the 
vo-tech  center  policies  and   procedures  manual. 
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During  our  field  work  we  visited  seven  high  schools  and  two 
vo-tech  centers  with   the  department  evaluation  team. 

Evaluation   Coverage 

The  department  only  evaluates  schools  which  operate  vocational 
programs  which  have  been  approved  for  state  excess  cost  funding 
by  the  department.  We  noted  that  of  the  169  accredited  secondary 
schools  in  Montana  there  are  112  schools  which  operate  department 
approved  vocational  programs  and  57  schools  operate  programs 
which  are  not  approved.  According  to  department  officials,  cur- 
rent OP!  policies  and  procedures  do  not  require  that  the  depart- 
ment conduct  vocational  education  evaluations  at  the  57  schools 
which  operate  practical  arts  courses  that  are  not  approved  (have 
not  operated  vocational  programs  according  to  department  stan- 
dards or  have  not  applied   for  state  excess  cost  funds). 

During  school  year  1983-84,  the  department  conducted  on-site 
evaluations  at  all  five  vo-tech  centers  for  the  first  time  since  the 
1976-77  school  year  and  conducted  evaluation  visits  at  thirty-one 
secondary  schools.  The  following  illustration  shows  department 
on-site  evaluation  activity  since  school   year  1977-78. 

DEPARTMENT   OF   VOCATIONAL   EDUCATION   SERVICES 
ON-SITE   VOCATIONAL    EDUCATION   PROGRAM   EVALUATIONS 
School  Years   1977-78   to   1983-84 

Number  of  Vo-Tech  Number  of   Secondary 

School  Year  Centers   Evaluated  Schools   Evaluated 

1977-78 
1978-79 
1979-80 
1980-81 
1981-82 
1982-83 
1983-84 

Source:      Compiled   by   the   Office   of    the   Legislative   Auditor 
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During  our  field  work  we  reviewed  the  number  of  schools 
given  on-site  evaluations  by  the  department  during  the  five-year 
period  from  school  year  1979-80  to  1983-84.  We  noted  that  the 
department  staff  conducted  on-site  evaluations  at  113  secondary 
schools  during  this  period.  However,  13  of  these  schools  were 
visited  twice  during  the  period  by  a  department  evaluation  team. 
As  a  result,  there  are  12  secondary  schools  with  approved  voca- 
tional education  programs  which  have  not  been  visited/evaluated  by 
the  department  during   the  last  five  years. 

The  department  should  develop  procedures  to  ensure  that  all 
approved  vocational  programs  arc  evaluated  within  the  required 
five-year  time  frame. 

RECOMMENDATION    #11 

WE  RECOMMEND  THE  DEPARTMENT  DEVELOP  PROCEDURES 
TO  ENSURE  THAT  ALL  APPROVED  VOCATIONAL  PROGRAMS 
ARE   EVALUATED   WITHIN   THE   FIVE-YEAR  TIME   FRAME. 


Evaluation   Duplication 

A  number  of  other  departments  within  OPI  conduct  various 
types  of  evaluations  at  secondary  schools.  The  accreditation 
reviews  done  by  the  Department  of  Basic  Instruction  Services 
cover  some  evaluation  areas  similar  to  those  done  by  the  Depart- 
ment of  Vocational   Education   Services. 

We  examined  on-site  visit  reports  completed  by  the  accredita- 
tion team  from  the  Department  of  Basic  Instruction  Services  and 
the  evaluation  reports  prepared  by  the  Department  of  Vocational 
Education  Services  evaluation  team  for  five  secondary  schools  that 
were  visited  by  both  teams  during  the  1983-84  school  year.  We 
found  areas  of  overlapping  coverage  and  repetition  in  the  results 
and  concerns  each  team  noted  in  their  reports.  The  major  areas 
of  duplication  are  student  follow-up,  facility  problems  related  to 
safety  hazards,    teacher  certification,   and  advisory  groups. 

We  also  compared  review/evaluation  activity  of  these  two 
departments  since  fiscal  year  1979-80.      During   the  five-year  period 
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from  school  year  1979-80  to  1983-84,  we  noted  that  57  secondary 
schools  received  on-site  reviews/evaluations  from  both  depart- 
ments. At  two  of  the  seven  high  schools  we  visited,  the  Depart- 
ment of  Vocational  Education  Services  evaluation  team,  and  an 
accreditation  review  team  from  the  Department  of  Basic  Instruction 
Services  both  were  conducting  a  separate  review  at  the  same  time. 
We  also  found  that  34  schools  did  not  receive  any  on-site  evalua- 
tions by  either  department,  and  25  schools  received  on-site  visits 
by  both  departments  in  the  same  year  during  the  five-year  period. 
Under  present  procedures  there  is  unnecessary  duplication  of 
evaluation  effort  by  both  departments.  This  duplication  represents 
unnecessary  employee  time  and  related  costs  that  could  be  better 
spent  on  other  activities.  The  Department  of  Vocational  Education 
Services  should  coordinate  its  evaluation  activity  with  other 
departments  within  OPI  to  ensure  adequate  evaluation  coverage 
with  a  minimum  of  duplication  of  effort. 

RECOMMENDATION   #12 

WE    RECOMMEND    THE    DEPARTMENT    COORDINATE    ITS    EVAL- 
UATION  ACTIVITY   WITH   OTHER   DEPARTMENTS  WITHIN   OPI. 


Follow-up  of  Department  Evaluation   Recommendations 

The  department  has  developed  procedures  to  follow-up  on 
school/center  compliance  with  evaluation  team  recommendations. 
The  department's  follow-up  process  at  the  school/center  level  relies 
on  a  written  response  from  school /center  officials  regarding  the 
progress  made  in  addressing  the  department's  recommendations. 
School/center  responses  are  reviewed  by  the  department  specialists 
in  the  applicable  program  areas.  The  specialists  have  the  respon- 
sibility to  follow-up  further  if  they  are  not  satisfied  with  the 
school/center  responses.  We  reviewed  the  adequacy  of  these 
procedures  and  the  extent  of  school/center  compliance  with  evalua- 
tion  recommendations. 

During  our  field  visits  to  14  secondary  schools  we  examined 
school    efforts    to    address    deficiencies    noted     in    the    most     recent 
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department  evaluation  report.  We  found  that  most  schools  did  not 
have  formal  procedures  for  addressing  evaluation  report  recommen- 
dations. We  also  noted  examples  of  past  recommendations  which 
had  not  been  addressed  by  many  of  the  schools  including  a  lack  of 
student  follow-up,  inactive  advisory  committees,  and  no  needs 
assessments.  Several  secondary  school  officials  indicated  that  the 
department's  on-site  evaluations  had  little  or  no  effect  on  their 
programs.  During  our  fieldwork  we  also  found  that  two  of  the 
thirty-one  secondary  schools  evaluated  by  the  department  during 
fiscal  year  1983-84  have  not  provided  written  responses  to  evalua- 
tion recommendations.  Four  other  schools  submitted  responses 
after  the  department's  deadlines. 

We  a'so  examined  vo-tech  center  efforts  to  respond  to  depart- 
ment evaluation  recommendations.  We  found  that  some  center 
officials  provided  limited  responses  to  department  evaluation  rec- 
ommendations. For  example,  one  center  only  commented  on  those 
recommendations  they  believe  were  most  critical  and  another  center 
did   not  directly   respond  to  the   report   recommendations. 

The  department's  follow-up  process  does  not  assure  adequate 
school/center  response  to  evaluation  recommendations  because  it 
does  not  confirm  that  the  schools/centers  have  actually  addressed 
the  recommendations.  Without  an  effective  follow-up  process,  the 
schools/centers  may  not  be  addressing  department  recommendations 
for  program   improvement. 

The  department  should  require  schools/centers  to  address 
evaluation  recommendations.  The  department  should  also  visit  a 
sample  of  schools  and  vo-tech  centers  each  year  to  determine  the 
adequacy  of  school/center  efforts  to  address  department  evaluation 
reconnendations. 

RECOMMENDATION   #13 

WE   RECOMMEND   THE   DEPARTMENT: 

A.  REQUIRE  SCHOOLS/CENTERS  TO  ADDRESS  DEPART- 
MENT EVALUATION  RECOMMENDATIONS  ON  A  TIMELY 
BASIS. 
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VISIT  A  SAMPLE  OF  SCHOOLS  AND  VO-TECH  CENTERS 
TO  ASSESS  SCHOOL/CENTER  EFFORTS  TO  ADDRESS 
DEPARTMENT   EVALUATION    RECOMMENDATIONS. 


DEPARTMENT   ENFORCEMENT  ACTIVITY 

Durinc]  our  audit  wg  noted  a  failure  on  the  part  of  most  of 
the  schools  and  vo-tech  centers  to  adequately  comply  with 
applicable  vocational  education  laws,  administrative  rules  and 
department  policies  and  procedures.  The  schools  and  centers  are 
also  in  some  cases  not  responding  to  department  recommendations 
and  not  making   needed  corrections  on  a  timely  basis. 

These  problems  may  be  occurring  because  the  department  has 
not  been  adequately  enforcing  its  secondary  school  and  vo-tech 
center  requirements.  During  the  audit  we  noted  that  the  depart- 
ment has  consistently  not  penalized  the  schools/centers  for  non- 
compliance with  applicable  rules  and  regulations.  Department 
officials  have  required  some  secondary  schools  to  payback  state 
excess  cost  funds  based  on  inappropriate  expenditures  of  the 
funds.  However,  department  officials  noted  that  none  of  the 
schools/centers  have  in  recent  years  been  penalized  or  have  had 
funding  withheld  for  failure  to  comply  with  department  compliance 
guidelines  regarding  areas  such  as  planning,  needs  assessment, 
and  teacher  certification. 

Department  secondary  vocational  education  guidelines  note 
that  vocational  education  programs  may  be  placed  on  probation  for 
not  adhering  to  program  standards,  noncompliance  with  Civil 
Rights  or  sex  equity  requirements,  inappropriate  expenditures  or 
noncompliance  with  reporting  deadlines.  There  are  no  specific 
guidelines  regarding  placing  vo-tech  centers  on  probation.  During 
our  review  of  the  department's  listing  of  vocational  education 
programs  on  probation  for  school  year  1984-85,  we  noted  that  only 
one  school  vocational  education  program  was  listed  as  on  probation. 
We  did  not  note  any  other  department  probation  listings  of  schools 
or    vo-tech    centers    which    were    not    in    compliance    with    department 
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rules  and  guidelines  related  to  such  areas  as  planning,  needs 
assessment,   and  teacher  certification. 

During  our  visits  to  twelve  approved  (receive  department 
excess  cost  funding)  secondary  schools  we  found  that  vocational 
programs  at  all  of  the  schools  should  be  on  probation,  if  the 
department's  criteria  for  placing  schools  on  probation  were 
enforced.  We  also  noted  that  school/center  officials  more 
frequently  addressed  the  department  on-site  evaluation  recommen- 
dations related  to  the  vocational  education  programs,  but  do  not 
adequately  address  department  evaluation  recommendations  directed 
at  school/center  administrative  responsibilities  including  planning, 
needs  assessments,   and  teacher  certification. 

Without  adequate  enforcement  schools/centers  administer 
vocational  programs  that  lack  adequate  direction  or  may  not  be 
meeting  the  needs  of  the  students  and  employers.  The  department 
should  more  actively  enforce  secondary  school  and  vo-tech  center 
compliance  with  applicable  requirements. 

RECOMMENDATION   #U 

WE  RECOMMEND  THE  DEPARTMENT  REQUIRE  SECONDARY 
SCHOOLS  AND  VO-TECH  CENTERS  TO  COMPLY  WITH  APPLI- 
CABLE VOCATIONAL  EDUCATION    REQUIREMENTS. 
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CHAPTER  VII 

SUMMARY 

In  Chapter  ^  we  identified  issues  regarding  the  operation  of 
vocational  education  programs  at  secondary  schools  and  vo-tech 
centers.  Chapter  VI  includes  issues  related  to  department  manage- 
ment of  these  activities.  These  issues  raise  an  overall  question 
regarding  the  adequacy  of  the  current  system  to  effectively  man- 
age vocational  education  at  secondary   schools  and  vo-tech  centers. 

Under  the  current  management  system,  the  Superintendent  of 
Public  Instruction,  through  the  Assistant  Superintendent  for 
Vocational  Education  Services  and  the  Department  of  Vocational 
Education  Services,  is  responsible  for  providing  overall  control  and 
guidance  of  vocational  education  at  the  secondary  school  and 
vo-tech  center  level.  Our  audit  has  noted  the  following  problems 
with  the  current  administration  and  management  of  vocational 
education   programs. 

1.  Inadequate  school/center  vocational  education   planning. 

2.  Lack  of  needs  assessment  data  available  to  the  schools/cen- 
ters. 

3.  Inadequate  student/employer  follow-up  data  available  to  the 
schools/centers  to  assess  the  effectiveness  of  vocational 
education   programs  and   related  curriculum. 

4.  Inactive  advisory  councils/program  advisory  committees. 

5.  Informal   school/center  curriculum  development  processes. 

6.  Lack  of  teacher  development   in   vocational   teaching  areas. 

7.  Noncertified  teachers  teaching  outside  their  areas  of  endorse- 
ment. 

8.  Inadequate  school/center  job  placement/job  development  activity. 

9.  Lack  of  policies  and  procedures  to  determine  school/center 
equipment  needs. 

10.      Weaknesses    in    the    department's    vocational    education    manage- 
ment information   system. 
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11.      Inefficient      and      ineffective      department      on-site      evaluation 
process   including  duplication   and   inadequate  follow-up. 


As  noted  earlier  many  of  these  problems  have  resulted  from 
schools/centers  not  complying  with  already  established  laws,  admin- 
istrative rules  and  policies  and  procedures,  and  because  of  depart- 
ment failure  to  properly  evaluate  school/center  activities  and 
enforce  applicable  requirements.  These  problems  are  occurring  at 
both  the  secondary  and  vo-tech  center  level. 

Our  surveys  of  past  vocational  students  and  employers  show 
that  there  is  still  general  satisfaction  with  vocational  education 
being  provided  by  secondary  schools  and  vo-tech  centers.  During 
our  audit  we  contacted  a  sample  of  school  year  1982-83  graduates 
from  the  schools/centers  we  visited.  We  also  contacted  a  sample  of 
75  employers  of  vo-tech  center  graduates.  We  asked  both  the 
graduates  and  employers  to  provide  an  overall  rating  of  school/ 
center  vocational  education  programs  and  training.  Eighty-nine 
percent  of  both  the  school  and  center  graduates  gave  the  vocational 
education  they  received  an  overall  rating  of  average  or  better.  V/e 
also  noted  that  84  percent  of  the  employers  we  contacted  gave  the 
vocationally  trained  vo-tech  center  graduates  an  overall  rating  of 
average  or  better. 

Recent  efforts  to  revise  state  laws  that  relate  to  the  five 
vocational-technical  centers  and  changes  in  the  administrative  rules 
which  affect  vocational  education  have  provided  some  clarification 
regarding  the  roles  and  responsibilities  of  groups  involved  in 
vocational  education.  During  the  audit  we  also  noted  improvement 
in  department  efforts  to  more  effectively  manage  vocational  educa- 
tion including  more  extensive  review/evaluation  of  vo-tech  center 
programs  and  activities  and  increased  on-site  evaluations  of  the 
secondary   schools. 

The  fact  that  report  recommendations  are  addressed  to  the 
Office  of  Public  Instruction  and  the  Department  of  Vocational 
Education  Services  is  not  meant  to  imply  that  OPI  and  the  depart- 
ment alone  are  responsible  for  the  noted  issues.  The  administra- 
tors  and    school    boards    for   secondary    schools   and   vo-tech    centers 
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have  a  responsibility  to  comply  with  state  and  federal  guidelines. 
The  current  administration  and  management  of  vocational  education 
programs  could  be  more  effective  and  efficient  if  the  schools/ 
centers  and  department  work  together  to  correct  deficiencies.  The 
department  should  also  more  actively  enforce  applicable  vocational 
education   requirements  to  ensure  school/center  compliance. 
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OFFICE  OF   PUBLIC    INSTRUCTION    RESPONSE 


The  Office  of  Public  Instruction 

„,  .         ■    .  ..  .^SS^i^  State  Capitol 

Ed  Argenbnght  #^Jk  Helena.  Montana  59620 

State  Superintendent  fe^^^^^  (406)  449-3654 


November   26,    198^* 

m\l  6  6  i934 

Mr.   Scott   A.   Seacat  "O^'TANA  LtUlSLAllVE  AUDITOR 

Deputy   Legislative   Auditor 

Office  of  the   Legislative  Auditor 

State  Capitol 

Helena,  Montana     59620 

Dear   Mr.   Seacat: 

This  correspondence  is  issued  in  response  to  your  letter  of  November  19,  1984  which 
requested  written  response  to  the  recommendations  of  the  Performance  Audit  -  Office 
of   Public   Instruction   -    Department   of   Vocational   Education   Services. 

Prior  to  addressing  the  specific  recommendations  of  the  audit  report,  1  am  obligated  to 
reiterate  concerns  expressed  nearly  two  years  prior  to  the  receipt  of  the  audit 
findings.  It  has  never  been  made  clear  to  my  office  where  the  initial  impetus  was 
generated  to  performance  audit  the  Department  of  Vocational  Education  Services. 
Given  the  duration  and  costs  of  the  audit,  it  would  seem  appropriate  to  identify  the 
source  to  ensure  the  legitimacy  of  the  inquiry.  This  is  not  to  request  the  divulging  of 
a  professional  confidence  nor  is  it  intended  to  cast  aspersions.  It  is  simply  a  question 
that  has  arisen  on  several  occasions  yet  never  has  really  been  responded  to. 

A  second  comment  relates  the  operant  philosophy  of  my  administration  that  recognizes 
and  supports  local  decision  making  based  upon  local  input.  This  basic  reference  point 
appears  to  be  in  conflict  with  the  general  tenor  of  the  audit  report  in  that  more 
centralization  and  enforcement  activities  are  recommended. 

My  final  introductory  remark  is  offered  to  place  in  perspective  singular  views,  in  time, 
taken  of  dynamic  enterprises.  The  progression  of  change  noted  in  the  report  from  the 
time  of  the  feasibility  survey  to  actual  audit  activities  notes  substantial  improvements. 
To  this  end,  the  audit  may  indeed  reflect  an  effect  of  change  rather  than  the  cause 
of  change   within   the   Department. 

Given  the  positions  noted,  responses  to  the  audit  report  "Recommendations"  will  be 
made  in   numeric   order. 
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Recommendation  //I 

We  recommend  the   Department: 

A.  Revise  the  present  format  for  secondary  school  vocational  education  planning 
documents. 

Response:  Concur.  With  the  passage  of  a  new  federal  law  for  vocational 
education,  the  revision  of  documents,  planning  and  evaluation  processes  is 
assured. 

B.  Require  schools/centers  to  comply  with  department  planning  document  formats 
and  deadlines. 

Response:     Concur. 

Recommendation  #2 

We  recommend  the  department: 

A.  Conduct  periodic  regional  vocational  education  and  occupational  needs 
assessments  within  Montana  and  make  the  results  available  to  the 
schools/centers. 

Response:  Partially  concur.  It  is  recognized  that  many  agencies  collect 
data  relative  to  the  topic  and  that  a  compilation  of  data  may  be  appropiate 
for  subsections  of  the  state.  This  data  generally  is  available  in  complete 
cycles  every  three  years  which  will  correspond  to  the  new  federal  planning 
periods   and   is   appropriate   for   state  planning   purposes. 

B.  Establish   specific   criteria  and   format    for   the   regional   needs  assessments. 
Response:     Concur. 

C.  Provide  schools/centers  assistance  in  the  use  of  the  regional  needs 
assessments. 

4 

Response:     Concur,  within   the  limitations  of  fiscal  constraints. 

D.  Revise  administrative  rules  so  that  schools/centers  are  not  required  to 
conduct  extensive  needs  assessments. 

Response:      Concur. 
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Recommendation  //  3 

We  recommend   the   Office  of   Public   Instruction: 

A.  Develop     a     centralized     student/employer     follow-up     system     that     will     meet 
vocational   and   accreditation   requirements. 

Response:  The  recommendation  is  well  taken  and  a  system  will  be  devised. 
Studies,  however,  tend  to  refute  the  concept  based  upon  the  response  rate 
compared   to  response    to   a  "local"  entity. 

B.  Provide  follow-up  results   to  the  schools/centers. 

Response:  Concur.  The  response  rate  may  need  to  be  improved  by  soliciting 
follow-up  and  reporting  back  to  the  state  for  low   level  respondents. 

C.  Revise       administrative       rules       and       accreditation       standards       so       that 
schools/centers  are   not   required   to  conduct  student/employer   follow-up. 

Response:      The   recommendation   will   be   taken   under   advisement. 

Recommendation   //^ 

We  recommend   the  department: 

A.  Examine   the   role  and  current   requirements   for  advisory  councils  and  program 
advisory  committees. 

Response:     Concur. 

B.  Continue     to     provide     assistance     in    cooperation    with     MACVE    to    increase 
advisory /committee   participation. 

Response:  Concur.  Recognition  is  given  that  the  mechanism  to  encourage 
more  active  participation  may  extend  beyond  the  department  and  state 
council. 

Recommendation  U5 

We   recommend   the  department: 

A.        Require    a    formal    vocational    education    curriculum    development    and    review 
process   be   implemented   by   schools/centers. 

Response:  Concur.  Current  policies  and  procedures  as  well  as  guidelines 
address     curriculum.  A     review      will     be     made     to     determine     additional 

formalities   to  be  developed. 
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B.  Specify  types  of  information  school/center  officials  should  be  considering  for 
curriculum  development   and   review. 

Response:     Concur. 

C.  Obtain  and  consider  employer  input  as  part  of  department  core  curriculum 
development  process. 

Response:  Partially  concur.  At  this  juncture,  the  core  development  for  like 
program  offerings  at  the  postsecondary  center  level  do  reflect  local  input 
albeit  less  than  100  percent  at  each  location.  A  concerted  effort  will  be 
made   to   insure   local   reviews   of   recommended   core  curriculums. 

Recommendation   //6 

We   recommend   the   department: 

A.  Provide   additional   regional    training  sessions   for   vocational   education   teachers. 

Response:  The  recommendation  is  well  taken  and  supported  in  concept.  The 
issue  at  hand  is  the  fiscal  support  for  such  efforts.  At  present,  the 
department  depends  entirely  upon  federal  funds  for  these  activities.  No  state 
level  general  funds  are  allocated  to  the  department  to  provide  for  costs 
incurred  at   regional   meetings. 

Fiscal  year  1985  activities  for  regional  workshops  are  currently  planned  and 
funded   with   federal   funds. 

B.  Propose  to  the  Board  of  Public  Education  specific  requirements  that 
vocational  teachers  take  at  least  a  minimum  number  of  trade-related  courses 
over   a  specified   time   period. 

Response:      The   recommendation   will   be   taken   under   advisement. 
Recommendation   //7 

We     recommend      the     department     develop     and     coordinate     procedures     which     verify 
certification  of   vocational  education   teachers. 

Response:  Current  law  requires  the  certification  of  instructional  staff  under 
20-3-205  Powers  and  duties  (3)  and  20-4-202  Teacher  specialist  certification 
registration.  Verification  from  county  superintendents  will  be  requested  at 
specific  intervals  throughout  the  year.  Internal  communications  will  be 
addressed  to  ensure  the  adequate   flow   of   information. 
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Recommendation  tf8 

Vie  recommend   the  department: 

A.  Examine    the    need    for    job    placement    and    job    development    at    the    secondary 
school  level  and   revise  administrative  rules  accordingly. 

Response:     Concur. 

B.  Ensure     that      vo-tech     centers     are     providing     the     required     levels     of     job 
placement   and   job   development   services. 

Response:  The     recommendation      will     be      taken     under     advisement     with 

resolution  dependent  upon  recognition  and  funding  of  adequate  staffing 
patterns. 

C.  Coordinate     placement     activity     with     the     State     Department     of     Labor     and 
Industry,   Job   Services   Division. 

Response:      Concur. 

Recommendation   //9 

We     recommend     the     department     establish     policies     and     procedures     for     determining 
equipment  needs  and   replacement  of  out-of-date  equipment. 

Response:  Partially  concur.  There  is  a  need  to  establish  guidelines  for  the 
acquisition  and  replacement  of  equipment.  However,  the  commitment  of 
funds,  if  other  than  specific  state  set-aides,  is  a  local  decision  that  is 
predicated   upon  a  multitude  of  factors  best  addressed   by   local  boards. 

Recommendation   //IQ 

We  recommend   the   department: 

A.  Assist   schools/centers   in   developing   better   management   information   systems. 

Response:  Concur.  The  need  to  devote  staff  time  at  the  state  level  to 
define  elements  of  common  definition  for  management  information  systems  is 
very  evident.  The  priority  of  this  recommendation  will  be  reviewed  in  the 
light  of   total   responsibilities. 

B.  Review     adequacy     of     present     department     guidelines     in     the     management 
information  area  for  secondary  schools/vo-tech  centers. 

Response:     Concur. 
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C.        Improve  procedures   to  ensure  collection  of  adequate  management  information. 

Response:     Concur. 

Recommendation   //il 

Sf/e     recommend     the     department     develop     procedures     to     ensure     that     all     approved 
vocational   programs   are   evaluated   within    the   five-year    time   frame. 

Response:  Concur.  It     should     be     noted     that,     at     the     onset     of     my 

administration,  the  mandated  evaluation  of  programs  was  behind  schedule  to 
the  extent  that  it  has  taken  nearly  three  years  to  "catch  up"  to  the  past 
schedule.  At  the  conclusion  of  this  school  year,  the  departinent  will  return 
to   a   20   percent    five-year   evaluation  cycle. 

Recommendation   #12 

We      recommend      the      department      coordinate      its      evaluation      activity      with      other 
departments   within   OPI. 

Response:     Concur.      This  will  be  accomplished   to   the  extent  practical. 

Recommendation  #13 

*e  recommend   the  department: 

A.  Require  schools/centers   to  address  department   evaluation   recommendations  on 
a  timely   basis. 

Response:      Concur. 

B.  Visit   a   sample   of   schools   and   vo-tech   centers    to   assess   school/center   efforts 
to   address   department   evaluation   recommendations. 

Response:  This  recommendation  will  be  reviewed  in  light  of  performance 
audits  required  under  AI02  Attachment  P,  data  collected  by  the  management 
information  systems  and  self-reviews.  If  discrepancies  are  noted,  monitoring 
activities   will  be  initiated   within   fiscal  constraints. 

Recommendation  #1^ 

We  recommend  the  department  require  secondary  schools  and  vo-tech  centers  to  comply 
with  applicable   vocational  education   requirements. 

Response:     Concur. 


54 


Mr.  Scott  A.  Seacat 
November  26,  198^ 


Page  7 


The  activities  involved  with  this  performance  audit  and  the  concomitant  changes  that 
have  occurred  appear  to  have  strengthened  vocational  education  services.  We  wish  to 
acknowledge   the  cooperation   existing   in   this   study. 

We  trust  that  recommendations  carrying  obvious  fiscal  notes  will  be  duly  deliberated 
and   supported   in   appropriate  committees  of   the   upcoming   legislature. 


ibright 
State  Superintendent 
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